2025.03.05 21:13:30.546229 [ 577 ] {} <Warning> Context: Server was built in debug mode. It will work slowly.
2025.03.05 21:13:30.547140 [ 577 ] {} <Warning> Context: ThreadFuzzer is enabled. Application will run slowly and unstable.
2025.03.05 21:13:30.866933 [ 577 ] {} <Warning> Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl.
2025.03.05 21:13:30.873880 [ 577 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2025.03.05 21:13:30.874667 [ 577 ] {} <Warning> Application: Integrity check of the executable skipped because the reference checksum could not be read.
2025.03.05 21:13:35.690876 [ 577 ] {} <Warning> CloudPlacementInfo: Placement info has not been loaded
2025.03.05 21:13:39.020530 [ 577 ] {} <Warning> KeeperLogStore: No logs exists in /var/lib/clickhouse/coordination/logs. It's Ok if it's the first run of clickhouse-keeper.
2025.03.05 21:13:39.068261 [ 577 ] {} <Warning> KeeperLogStore: Removing all changelogs
2025.03.05 21:13:39.160088 [ 577 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2025.03.05 21:13:39.264172 [ 577 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2025.03.05 21:13:39.264739 [ 577 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2025.03.05 21:13:39.326450 [ 1190 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2025.03.05 21:13:40.104649 [ 577 ] {} <Warning> Access(local_directory): File /var/lib/clickhouse/access/users.list doesn't exist
2025.03.05 21:13:40.105388 [ 577 ] {} <Warning> Access(local_directory): Recovering lists in directory /var/lib/clickhouse/access/
2025.03.05 21:13:42.710612 [ 577 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2025.03.05 21:15:27.236769 [ 1377 ] {} <Error> ZooKeeperClient: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e5d2c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e4ea0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5da6a
8. /build/src/IO/ReadBuffer.h:106: DB::ReadBuffer::read(char*, unsigned long) @ 0x000000000af5d813
9. /build/src/IO/ReadBuffer.h:197: DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x000000000afd1be8
10. /build/src/IO/ReadHelpers.h:118: void DB::readPODBinary<int>(int&, DB::ReadBuffer&) @ 0x00000000133856e2
11. /build/src/IO/ReadHelpers.h:1303: void DB::readBinary<int>(int&, DB::ReadBuffer&) @ 0x000000001338569d
12. /build/src/IO/ReadHelpers.h:1340: void DB::readBinaryEndian<(std::endian)64206, int>(int&, DB::ReadBuffer&) @ 0x000000001d41bb3d
13. /build/src/IO/ReadHelpers.h:1353: void DB::readBinaryBigEndian<int>(int&, DB::ReadBuffer&) @ 0x000000001d41bafd
14. /build/src/Common/ZooKeeper/ZooKeeperIO.h:51: void Coordination::read<int>(int&, DB::ReadBuffer&) @ 0x000000001d41623d
15. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:289: void Coordination::ZooKeeper::read<int>(int&) @ 0x000000001e2511ed
16. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:807: Coordination::ZooKeeper::receiveEvent() @ 0x000000001e24658c
17. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:773: Coordination::ZooKeeper::receiveThread() @ 0x000000001e245fd9
18. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:398: Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1::operator()() const @ 0x000000001e24c498
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24c475
20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24c459
21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&) @ 0x000000001e24c3bd
22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&&)::'lambda'()::operator()() @ 0x000000001e24c2e5
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24c255
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24c235
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24c215
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24c1e0
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
 (version 24.3.12.76.altinitystable)
2025.03.05 21:15:27.548031 [ 1366 ] {} <Error> ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:47056 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e7844
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:303: Coordination::ZooKeeper::flushWriteBuffer() @ 0x000000001e23c5fd
9. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:707: Coordination::ZooKeeper::sendThread() @ 0x000000001e245269
10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:397: Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0::operator()() const @ 0x000000001e24bc58
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24bc35
12. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24bc19
13. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0&, std::tuple<>&) @ 0x000000001e24bb7d
14. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0&&)::'lambda'()::operator()() @ 0x000000001e24baa5
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24ba15
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24b9f5
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24b9d5
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24b9a0
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
21. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
22. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
24. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
25. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
26. ? @ 0x00007f39ff263ac3
27. ? @ 0x00007f39ff2f5850
 (version 24.3.12.76.altinitystable)
2025.03.05 21:15:28.154698 [ 1377 ] {} <Error> ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a06f07
4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0b047
5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022891a27
6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a136b
7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x000000002289fd09
8. /build/base/poco/Net/src/SocketImpl.cpp:272: Poco::Net::SocketImpl::shutdown() @ 0x00000000228a2732
9. /build/base/poco/Net/src/StreamSocket.cpp:109: Poco::Net::StreamSocket::shutdown() @ 0x00000000228a645e
10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:1032: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000001e23d2e9
11. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:795: Coordination::ZooKeeper::receiveThread() @ 0x000000001e2463df
12. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:398: Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1::operator()() const @ 0x000000001e24c498
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24c475
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24c459
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&) @ 0x000000001e24c3bd
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&&)::'lambda'()::operator()() @ 0x000000001e24c2e5
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24c255
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24c235
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24c215
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24c1e0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
28. ? @ 0x00007f39ff263ac3
29. ? @ 0x00007f39ff2f5850
 (version 24.3.12.76.altinitystable)
2025.03.05 21:15:28.616912 [ 580 ] {ea1c1266-d814-48f9-901f-e4f285e7c444} <Warning> InterpreterCreateQuery: ATTACH TABLE query with full table definition is not recommended: use either ATTACH TABLE hits_v1; to attach existing table or CREATE TABLE hits_v1 <table definition>; to create new table or ATTACH TABLE hits_v1 FROM '/path/to/data/' <table definition>; to create new table and attach data.
2025.03.05 21:15:42.577289 [ 580 ] {4d255509-98ac-437d-8902-35d105810ac6} <Warning> InterpreterCreateQuery: ATTACH TABLE query with full table definition is not recommended: use either ATTACH TABLE visits_v1; to attach existing table or CREATE TABLE visits_v1 <table definition>; to create new table or ATTACH TABLE visits_v1 FROM '/path/to/data/' <table definition>; to create new table and attach data.
2025.03.05 21:16:14.446517 [ 1183 ] {} <Error> RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled
2025.03.05 21:16:20.732919 [ 1447 ] {} <Warning> Context: Server was built in debug mode. It will work slowly.
2025.03.05 21:16:20.733748 [ 1447 ] {} <Warning> Context: ThreadFuzzer is enabled. Application will run slowly and unstable.
2025.03.05 21:16:21.131721 [ 1447 ] {} <Warning> Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl.
2025.03.05 21:16:21.138446 [ 1447 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2025.03.05 21:16:21.139174 [ 1447 ] {} <Warning> Application: Integrity check of the executable skipped because the reference checksum could not be read.
2025.03.05 21:16:25.990706 [ 1447 ] {} <Warning> CloudPlacementInfo: Placement info has not been loaded
2025.03.05 21:16:29.394766 [ 1447 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2025.03.05 21:16:29.455232 [ 1447 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2025.03.05 21:16:29.455928 [ 1447 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2025.03.05 21:16:29.531603 [ 2054 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2025.03.05 21:16:44.133882 [ 1447 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2025.03.05 21:18:42.976996 [ 2259 ] {} <Error> ZooKeeperClient: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e5d2c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e4ea0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5da6a
8. /build/src/IO/ReadBuffer.h:106: DB::ReadBuffer::read(char*, unsigned long) @ 0x000000000af5d813
9. /build/src/IO/ReadBuffer.h:197: DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x000000000afd1be8
10. /build/src/IO/ReadHelpers.h:118: void DB::readPODBinary<int>(int&, DB::ReadBuffer&) @ 0x00000000133856e2
11. /build/src/IO/ReadHelpers.h:1303: void DB::readBinary<int>(int&, DB::ReadBuffer&) @ 0x000000001338569d
12. /build/src/IO/ReadHelpers.h:1340: void DB::readBinaryEndian<(std::endian)64206, int>(int&, DB::ReadBuffer&) @ 0x000000001d41bb3d
13. /build/src/IO/ReadHelpers.h:1353: void DB::readBinaryBigEndian<int>(int&, DB::ReadBuffer&) @ 0x000000001d41bafd
14. /build/src/Common/ZooKeeper/ZooKeeperIO.h:51: void Coordination::read<int>(int&, DB::ReadBuffer&) @ 0x000000001d41623d
15. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:289: void Coordination::ZooKeeper::read<int>(int&) @ 0x000000001e2511ed
16. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:807: Coordination::ZooKeeper::receiveEvent() @ 0x000000001e24658c
17. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:773: Coordination::ZooKeeper::receiveThread() @ 0x000000001e245fd9
18. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:398: Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1::operator()() const @ 0x000000001e24c498
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24c475
20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24c459
21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&) @ 0x000000001e24c3bd
22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&&)::'lambda'()::operator()() @ 0x000000001e24c2e5
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24c255
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24c235
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24c215
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24c1e0
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
 (version 24.3.12.76.altinitystable)
2025.03.05 21:18:43.299191 [ 2261 ] {} <Error> ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:40138 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e7844
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:303: Coordination::ZooKeeper::flushWriteBuffer() @ 0x000000001e23c5fd
9. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:707: Coordination::ZooKeeper::sendThread() @ 0x000000001e245269
10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:397: Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0::operator()() const @ 0x000000001e24bc58
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24bc35
12. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24bc19
13. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0&, std::tuple<>&) @ 0x000000001e24bb7d
14. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0&&)::'lambda'()::operator()() @ 0x000000001e24baa5
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24ba15
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24b9f5
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24b9d5
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24b9a0
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
21. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
22. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
24. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
25. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
26. ? @ 0x00007f017766aac3
27. ? @ 0x00007f01776fc850
 (version 24.3.12.76.altinitystable)
2025.03.05 21:18:43.702157 [ 2259 ] {} <Error> ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a06f07
4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0b047
5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022891a27
6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a136b
7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x000000002289fd09
8. /build/base/poco/Net/src/SocketImpl.cpp:272: Poco::Net::SocketImpl::shutdown() @ 0x00000000228a2732
9. /build/base/poco/Net/src/StreamSocket.cpp:109: Poco::Net::StreamSocket::shutdown() @ 0x00000000228a645e
10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:1032: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000001e23d2e9
11. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:795: Coordination::ZooKeeper::receiveThread() @ 0x000000001e2463df
12. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:398: Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1::operator()() const @ 0x000000001e24c498
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24c475
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24c459
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&) @ 0x000000001e24c3bd
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&&)::'lambda'()::operator()() @ 0x000000001e24c2e5
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24c255
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24c235
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24c215
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24c1e0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
28. ? @ 0x00007f017766aac3
29. ? @ 0x00007f01776fc850
 (version 24.3.12.76.altinitystable)
2025.03.05 21:25:43.182465 [ 2090 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {1debc995-8692-4c42-954c-57d52f901198::202503_1_25_5}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x00000000132e996c
6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e6d5f
7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013255905
8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13e718
9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13de76
10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba8a15
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba89dd
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 21:27:17.401963 [ 2087 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {9f912096-7afb-496b-86c7-16abf59bb4e4::202503_1_75_15}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x00000000132e996c
6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e6d5f
7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013255905
8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13e718
9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13de76
10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba8a15
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba89dd
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 21:35:28.117411 [ 2089 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {9f912096-7afb-496b-86c7-16abf59bb4e4::202503_1_140_28}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x00000000132e996c
6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e6d5f
7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013255905
8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13e718
9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13de76
10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba8a15
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba89dd
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 21:41:35.525329 [ 2094 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_1_333_90}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x00000000132e996c
6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e6d5f
7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013255905
8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13e718
9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13de76
10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba8a15
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba89dd
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 21:42:30.615534 [ 2090 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_1_344_101}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x00000000132e996c
6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e6d5f
7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013255905
8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13e718
9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13de76
10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba8a15
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba89dd
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 21:44:42.105628 [ 2092 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_1_375_132}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x00000000132e996c
6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e6d5f
7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013255905
8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13e718
9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13de76
10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba8a15
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba89dd
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 21:49:13.219149 [ 2085 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_1_443_187}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x00000000132e996c
6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e6d5f
7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013255905
8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13e718
9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13de76
10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba8a15
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba89dd
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 21:59:36.837995 [ 2083 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_569_589_4}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x00000000132e996c
6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e6d5f
7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013255905
8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13e718
9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13de76
10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba8a15
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba89dd
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:06:48.519443 [ 2090 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fe5b5b83-eea3-482d-90c9-5c8d7754068a::202503_1_296_60}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x00000000132e996c
6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e6d5f
7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013255905
8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13e718
9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13de76
10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba8a15
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba89dd
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:11:15.306428 [ 2096 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {09669507-4528-4e20-b87c-26ebd7ba8c50::202503_1_421_84}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x00000000132e996c
6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e6d5f
7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013255905
8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13e718
9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13de76
10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba8a15
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba89dd
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:11:57.912084 [ 2082 ] {} <Warning> CgroupsMemoryUsageObserver: Exceeded soft memory limit (13.77 GiB)
2025.03.05 22:13:13.142179 [ 2082 ] {} <Warning> CgroupsMemoryUsageObserver: Exceeded hard memory limit (14.54 GiB)
2025.03.05 22:13:13.142843 [ 2082 ] {} <Warning> CgroupsMemoryUsageObserver: Exceeded soft memory limit (13.77 GiB)
2025.03.05 22:15:13.634066 [ 2082 ] {} <Warning> CgroupsMemoryUsageObserver: Exceeded hard memory limit (14.54 GiB)
2025.03.05 22:15:13.634671 [ 2082 ] {} <Warning> CgroupsMemoryUsageObserver: Exceeded soft memory limit (13.77 GiB)
2025.03.05 22:18:13.857328 [ 2082 ] {} <Warning> CgroupsMemoryUsageObserver: Exceeded soft memory limit (13.77 GiB)
2025.03.05 22:19:00.294972 [ 2093 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_670_858_57}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x00000000132e996c
6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e6d5f
7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013255905
8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13e718
9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13de76
10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba8a15
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba89dd
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:19:59.918368 [ 2082 ] {} <Warning> CgroupsMemoryUsageObserver: Exceeded soft memory limit (13.77 GiB)
2025.03.05 22:20:41.728941 [ 2088 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_670_885_77}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x00000000132e996c
6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e6d5f
7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013255905
8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13e718
9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13de76
10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba8a15
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba89dd
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:22:10.941378 [ 2094 ] {} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key s3/cmf/hpsdusxvwasbpwaizqpiedydnvchw, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b6c14f28-1a6b-4a73-98f5-8ad420fd5f03, upload has finished false.
2025.03.05 22:22:10.941573 [ 2094 ] {} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key s3/cmf/hpsdusxvwasbpwaizqpiedydnvchw, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b6c14f28-1a6b-4a73-98f5-8ad420fd5f03, upload has finished false
2025.03.05 22:22:10.964410 [ 2094 ] {} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key s3/cmf/hpsdusxvwasbpwaizqpiedydnvchw, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b6c14f28-1a6b-4a73-98f5-8ad420fd5f03, upload has finished false
2025.03.05 22:22:13.732837 [ 2056 ] {} <Error> RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled
2025.03.05 22:22:17.483393 [ 2806 ] {} <Warning> Context: Server was built in debug mode. It will work slowly.
2025.03.05 22:22:17.484308 [ 2806 ] {} <Warning> Context: ThreadFuzzer is enabled. Application will run slowly and unstable.
2025.03.05 22:22:18.212012 [ 2806 ] {} <Warning> Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production.
2025.03.05 22:22:18.280319 [ 2806 ] {} <Warning> Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl.
2025.03.05 22:22:18.323941 [ 2806 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2025.03.05 22:22:18.421431 [ 2806 ] {} <Warning> Application: Integrity check of the executable skipped because the reference checksum could not be read.
2025.03.05 22:22:34.112415 [ 2806 ] {} <Warning> CloudPlacementInfo: Placement info has not been loaded
2025.03.05 22:22:36.942932 [ 2806 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2025.03.05 22:22:36.957037 [ 2806 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2025.03.05 22:22:36.957886 [ 2806 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2025.03.05 22:22:37.024871 [ 3510 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2025.03.05 22:22:48.796868 [ 2806 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2025.03.05 22:24:36.352237 [ 3675 ] {} <Error> ZooKeeperClient: Code: 33. DB::Exception: Cannot read all data. Bytes read: 0. Bytes expected: 4. (CANNOT_READ_ALL_DATA), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<unsigned long&, String>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type, std::type_identity<String>::type>, unsigned long&, String&&) @ 0x000000000afd1e4c
6. /build/src/IO/ReadBuffer.h:199: DB::ReadBuffer::readStrict(char*, unsigned long) @ 0x000000000afd1c6f
7. /build/src/IO/ReadHelpers.h:118: void DB::readPODBinary<int>(int&, DB::ReadBuffer&) @ 0x00000000133856e2
8. /build/src/IO/ReadHelpers.h:1303: void DB::readBinary<int>(int&, DB::ReadBuffer&) @ 0x000000001338569d
9. /build/src/IO/ReadHelpers.h:1340: void DB::readBinaryEndian<(std::endian)64206, int>(int&, DB::ReadBuffer&) @ 0x000000001d41bb3d
10. /build/src/IO/ReadHelpers.h:1353: void DB::readBinaryBigEndian<int>(int&, DB::ReadBuffer&) @ 0x000000001d41bafd
11. /build/src/Common/ZooKeeper/ZooKeeperIO.h:51: void Coordination::read<int>(int&, DB::ReadBuffer&) @ 0x000000001d41623d
12. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:289: void Coordination::ZooKeeper::read<int>(int&) @ 0x000000001e2511ed
13. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:807: Coordination::ZooKeeper::receiveEvent() @ 0x000000001e24658c
14. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:773: Coordination::ZooKeeper::receiveThread() @ 0x000000001e245fd9
15. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:398: Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1::operator()() const @ 0x000000001e24c498
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24c475
17. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24c459
18. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&) @ 0x000000001e24c3bd
19. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&&)::'lambda'()::operator()() @ 0x000000001e24c2e5
20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24c255
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24c235
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24c215
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24c1e0
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
26. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
27. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
29. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
30. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
31. ? @ 0x00007f7a996d8ac3
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:36.618967 [ 3633 ] {} <Error> void DB::SystemLog<DB::TraceLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:36.768340 [ 3680 ] {} <Error> ZooKeeperClient: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:56988 -> [::1]:9181). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e7844
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:303: Coordination::ZooKeeper::flushWriteBuffer() @ 0x000000001e23c5fd
9. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:707: Coordination::ZooKeeper::sendThread() @ 0x000000001e245269
10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:397: Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0::operator()() const @ 0x000000001e24bc58
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24bc35
12. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24bc19
13. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0&, std::tuple<>&) @ 0x000000001e24bb7d
14. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_0&&)::'lambda'()::operator()() @ 0x000000001e24baa5
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24ba15
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24b9f5
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24b9d5
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24b9a0
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
21. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
22. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
24. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
25. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
26. ? @ 0x00007f7a996d8ac3
27. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:37.104601 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=1): (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_5_5_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 1 with max_rows_to_read = 6739): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:37.114164 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:37.453355 [ 3675 ] {} <Error> ZooKeeperClient: Poco::Exception. Code: 1000, e.code() = 107, Net Exception: Socket is not connected, Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/base/poco/Foundation/src/Exception.cpp:145: Poco::RuntimeException::RuntimeException(String const&, int) @ 0x0000000022a06f07
4. /build/base/poco/Foundation/src/Exception.cpp:164: Poco::IOException::IOException(String const&, int) @ 0x0000000022a0b047
5. /build/base/poco/Net/src/NetException.cpp:26: Poco::Net::NetException::NetException(String const&, int) @ 0x0000000022891a27
6. /build/base/poco/Net/src/SocketImpl.cpp:995: Poco::Net::SocketImpl::error(int, String const&) @ 0x00000000228a136b
7. /build/base/poco/Net/src/SocketImpl.cpp:914: Poco::Net::SocketImpl::error() @ 0x000000002289fd09
8. /build/base/poco/Net/src/SocketImpl.cpp:272: Poco::Net::SocketImpl::shutdown() @ 0x00000000228a2732
9. /build/base/poco/Net/src/StreamSocket.cpp:109: Poco::Net::StreamSocket::shutdown() @ 0x00000000228a645e
10. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:1032: Coordination::ZooKeeper::finalize(bool, bool, String const&) @ 0x000000001e23d2e9
11. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:795: Coordination::ZooKeeper::receiveThread() @ 0x000000001e2463df
12. /build/src/Common/ZooKeeper/ZooKeeperImpl.cpp:398: Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1::operator()() const @ 0x000000001e24c498
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24c475
14. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001e24c459
15. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&, std::tuple<>&) @ 0x000000001e24c3bd
16. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1>(Coordination::ZooKeeper::ZooKeeper(std::vector<Coordination::ZooKeeper::Node, std::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::shared_ptr<DB::ZooKeeperLog>)::$_1&&)::'lambda'()::operator()() @ 0x000000001e24c2e5
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001e24c255
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001e24c235
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001e24c215
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001e24c1e0
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
23. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
24. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
26. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
27. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:38.550975 [ 2811 ] {801c283d-7198-4a57-b72b-769a20a2f607} <Error> executeQuery: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.3.12.76.altinitystable) (from [::1]:39646) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1645
7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
16. ? @ 0x00007f7a996d8ac3
17. ? @ 0x00007f7a9976a850

2025.03.05 22:24:38.567931 [ 2811 ] {801c283d-7198-4a57-b72b-769a20a2f607} <Error> DynamicQueryHandler: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1645
7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
16. ? @ 0x00007f7a996d8ac3
17. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:38.754662 [ 2811 ] {ad680d69-6aba-40c6-9f4e-362b99c3dc0b} <Error> executeQuery: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.3.12.76.altinitystable) (from [::1]:39678) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1645
7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
16. ? @ 0x00007f7a996d8ac3
17. ? @ 0x00007f7a9976a850

2025.03.05 22:24:38.845794 [ 2811 ] {ad680d69-6aba-40c6-9f4e-362b99c3dc0b} <Error> DynamicQueryHandler: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1645
7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
16. ? @ 0x00007f7a996d8ac3
17. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:39.255553 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:40.020908 [ 2811 ] {7dc1e584-f5d3-4db9-80c3-86149457edb5} <Error> executeQuery: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.3.12.76.altinitystable) (from [::1]:39754) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1645
7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
16. ? @ 0x00007f7a996d8ac3
17. ? @ 0x00007f7a9976a850

2025.03.05 22:24:40.032908 [ 2811 ] {7dc1e584-f5d3-4db9-80c3-86149457edb5} <Error> DynamicQueryHandler: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1645
7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
16. ? @ 0x00007f7a996d8ac3
17. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:40.125968 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=10). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:40.657811 [ 3780 ] {7b54f698-92f8-407c-ae90-9067e8346260} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39800) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5110c8
13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb5220
14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
22. ? @ 0x00007f7a996d8ac3
23. ? @ 0x00007f7a9976a850

2025.03.05 22:24:40.678918 [ 3780 ] {7b54f698-92f8-407c-ae90-9067e8346260} <Error> DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5110c8
13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb5220
14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
22. ? @ 0x00007f7a996d8ac3
23. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:40.891751 [ 3828 ] {4d0f79ed-a05e-4e94-9d6d-e8cdd62fc228} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39860) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5110c8
13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb5220
14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
22. ? @ 0x00007f7a996d8ac3
23. ? @ 0x00007f7a9976a850

2025.03.05 22:24:40.904087 [ 3828 ] {4d0f79ed-a05e-4e94-9d6d-e8cdd62fc228} <Error> DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5110c8
13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb5220
14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
22. ? @ 0x00007f7a996d8ac3
23. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:41.460997 [ 3776 ] {e17988a0-d463-497f-bdcf-54186905c83e} <Error> executeQuery: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.3.12.76.altinitystable) (from [::1]:39940) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1645
7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
16. ? @ 0x00007f7a996d8ac3
17. ? @ 0x00007f7a9976a850

2025.03.05 22:24:41.481416 [ 3776 ] {e17988a0-d463-497f-bdcf-54186905c83e} <Error> DynamicQueryHandler: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1645
7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
16. ? @ 0x00007f7a996d8ac3
17. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:42.661012 [ 3777 ] {998ae81f-f774-44f8-8c6e-c21057c7704f} <Error> executeQuery: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.3.12.76.altinitystable) (from [::1]:39990) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1645
7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
16. ? @ 0x00007f7a996d8ac3
17. ? @ 0x00007f7a9976a850

2025.03.05 22:24:42.710535 [ 3777 ] {998ae81f-f774-44f8-8c6e-c21057c7704f} <Error> DynamicQueryHandler: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1645
7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
16. ? @ 0x00007f7a996d8ac3
17. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:42.913360 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:43.307367 [ 3776 ] {4177c4d0-1fa9-4fed-ae9f-f7c023677006} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37058) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5110c8
13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb5220
14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
22. ? @ 0x00007f7a996d8ac3
23. ? @ 0x00007f7a9976a850

2025.03.05 22:24:43.336259 [ 3776 ] {4177c4d0-1fa9-4fed-ae9f-f7c023677006} <Error> DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5110c8
13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb5220
14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
22. ? @ 0x00007f7a996d8ac3
23. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:44.297029 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:44.633542 [ 2811 ] {1ea242d8-aed2-44fc-a8c6-a33cc2072283} <Error> executeQuery: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.3.12.76.altinitystable) (from [::1]:37138) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1645
7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
16. ? @ 0x00007f7a996d8ac3
17. ? @ 0x00007f7a9976a850

2025.03.05 22:24:44.663943 [ 2811 ] {1ea242d8-aed2-44fc-a8c6-a33cc2072283} <Error> DynamicQueryHandler: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1645
7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
16. ? @ 0x00007f7a996d8ac3
17. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:44.855056 [ 3828 ] {9c7d5d24-8da4-4e33-9fd8-2ba3b21868f0} <Error> executeQuery: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS) (version 24.3.12.76.altinitystable) (from [::1]:37090) (in query: SELECT version(), arrayStringConcat(groupArray(value), ' ') FROM system.build_options WHERE name IN ('GIT_HASH', 'GIT_BRANCH') ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1645
7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
16. ? @ 0x00007f7a996d8ac3
17. ? @ 0x00007f7a9976a850

2025.03.05 22:24:44.888127 [ 3828 ] {9c7d5d24-8da4-4e33-9fd8-2ba3b21868f0} <Error> DynamicQueryHandler: Code: 704. DB::Exception: The query result was not cached because the query contains a non-deterministic function. Use setting `query_cache_nondeterministic_function_handling = 'save'` or `= 'ignore'` to cache the query result regardless or to omit caching. (QUERY_CACHE_USED_WITH_NONDETERMINISTIC_FUNCTIONS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Interpreters/executeQuery.cpp:1205: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb1645
7. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
8. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
9. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
10. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
16. ? @ 0x00007f7a996d8ac3
17. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:45.830257 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=0): (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_4_4_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6741): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:24:46.518749 [ 2809 ] {0df2df0a-1642-484e-bd8e-84c6870c9861} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54064) (comment: 00008_uniq.sql) (in query: SELECT uniq(UserID), uniqIf(UserID, CounterID = 800784), uniqIf(FUniqID, RegionID = 213) FROM test.hits ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:24:46.857725 [ 2809 ] {0df2df0a-1642-484e-bd8e-84c6870c9861} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:24:48.204057 [ 2811 ] {3f53b487-9644-406e-bdbc-f95ceccf8be1} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54086) (comment: 02421_formats_with_totals_and_extremes.gen.sql) (in query: select sum(number) from numbers(10) group by number % 2 with totals format CSV settings extremes=1;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:24:48.259681 [ 2811 ] {3f53b487-9644-406e-bdbc-f95ceccf8be1} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:24:49.025012 [ 3828 ] {38d56236-062e-4a8e-9f12-4bd271499cb2} <Error> executeQuery: Code: 475. DB::Exception: Sort FILL TO expression must be constant with numeric type. Actual '2024-02-17'. In scope SELECT * FROM users ORDER BY date ASC WITH FILL TO '2024-02-17' STEP toIntervalHour(1). (INVALID_WITH_FILL_EXPRESSION) (version 24.3.12.76.altinitystable) (from [::1]:54072) (comment: 03248_with_fill_string_crash.sql) (in query: SELECT * FROM users ORDER BY date WITH FILL TO '2024-02-17' STEP toIntervalHour(1);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6729: DB::(anonymous namespace)::QueryAnalyzer::resolveSortNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ac0fd
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8228: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09c243
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:24:49.028306 [ 3828 ] {38d56236-062e-4a8e-9f12-4bd271499cb2} <Error> TCPHandler: Code: 475. DB::Exception: Sort FILL TO expression must be constant with numeric type. Actual '2024-02-17'. In scope SELECT * FROM users ORDER BY date ASC WITH FILL TO '2024-02-17' STEP toIntervalHour(1). (INVALID_WITH_FILL_EXPRESSION), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6729: DB::(anonymous namespace)::QueryAnalyzer::resolveSortNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0ac0fd
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8228: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09c243
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:24:57.875739 [ 3776 ] {6e29bbe7-9cdf-452b-856b-3c9b7f32ea8d} <Error> executeQuery: Code: 48. DB::Exception: GROUPING SETS are not supported together with ROLLUP and CUBE. (NOT_IMPLEMENTED) (version 24.3.12.76.altinitystable) (from [::1]:33920) (comment: 02304_grouping_sets_with_rollup_cube.sql) (in query: SELECT number FROM numbers(10) GROUP BY GROUPING SETS ( number, number % 2 ) WITH ROLLUP;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8031: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09ac04
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
9. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
10. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
12. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
20. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
21. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
22. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
23. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
24. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
30. ? @ 0x00007f7a996d8ac3
31. ? @ 0x00007f7a9976a850

2025.03.05 22:24:57.896116 [ 3776 ] {6e29bbe7-9cdf-452b-856b-3c9b7f32ea8d} <Error> TCPHandler: Code: 48. DB::Exception: GROUPING SETS are not supported together with ROLLUP and CUBE. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8031: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09ac04
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
9. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
10. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
12. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
20. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
21. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
22. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
23. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
24. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
30. ? @ 0x00007f7a996d8ac3
31. ? @ 0x00007f7a9976a850

2025.03.05 22:24:58.061934 [ 3776 ] {5ddeaaab-a3d6-422c-b351-18d841da0b5e} <Error> executeQuery: Code: 48. DB::Exception: GROUPING SETS are not supported together with ROLLUP and CUBE. (NOT_IMPLEMENTED) (version 24.3.12.76.altinitystable) (from [::1]:33920) (comment: 02304_grouping_sets_with_rollup_cube.sql) (in query: SELECT number FROM numbers(10) GROUP BY GROUPING SETS ( number, number % 2 ) WITH CUBE;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8031: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09ac04
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
9. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
10. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
12. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
20. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
21. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
22. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
23. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
24. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
30. ? @ 0x00007f7a996d8ac3
31. ? @ 0x00007f7a9976a850

2025.03.05 22:24:58.086296 [ 3776 ] {5ddeaaab-a3d6-422c-b351-18d841da0b5e} <Error> TCPHandler: Code: 48. DB::Exception: GROUPING SETS are not supported together with ROLLUP and CUBE. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8031: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09ac04
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
9. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
10. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
12. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
20. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
21. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
22. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
23. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
24. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
25. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
26. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
27. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
28. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
29. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
30. ? @ 0x00007f7a996d8ac3
31. ? @ 0x00007f7a9976a850

2025.03.05 22:25:00.088899 [ 3777 ] {9f3425cb-960a-4bba-884c-2ad593b994b3} <Error> executeQuery: Code: 370. DB::Exception: Data type Nullable(Nothing) of column 'x' cannot be used in tables. (DATA_TYPE_CANNOT_BE_USED_IN_TABLES) (version 24.3.12.76.altinitystable) (from [::1]:33938) (comment: 03243_check_for_nullable_nothing_in_alter.sql) (in query: alter table src modify column x Nullable(Nothing);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000b49848c
6. /build/src/Storages/StorageFactory.cpp:30: DB::checkAllTypesAreAllowedInTable(DB::NamesAndTypesList const&) @ 0x000000001c36afab
7. /build/src/Storages/AlterCommands.cpp:1373: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c2501c1
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
9. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
10. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
11. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
12. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
13. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
19. ? @ 0x00007f7a996d8ac3
20. ? @ 0x00007f7a9976a850

2025.03.05 22:25:00.093623 [ 3777 ] {9f3425cb-960a-4bba-884c-2ad593b994b3} <Error> TCPHandler: Code: 370. DB::Exception: Data type Nullable(Nothing) of column 'x' cannot be used in tables. (DATA_TYPE_CANNOT_BE_USED_IN_TABLES), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000b49848c
6. /build/src/Storages/StorageFactory.cpp:30: DB::checkAllTypesAreAllowedInTable(DB::NamesAndTypesList const&) @ 0x000000001c36afab
7. /build/src/Storages/AlterCommands.cpp:1373: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c2501c1
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
9. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
10. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
11. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
12. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
13. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
19. ? @ 0x00007f7a996d8ac3
20. ? @ 0x00007f7a9976a850

2025.03.05 22:25:01.095373 [ 3777 ] {b7afb037-630e-4218-b3ca-c5f248d4745d} <Error> executeQuery: Code: 370. DB::Exception: Data type Nullable(Nothing) of column 'x' cannot be used in tables. (DATA_TYPE_CANNOT_BE_USED_IN_TABLES) (version 24.3.12.76.altinitystable) (from [::1]:33938) (comment: 03243_check_for_nullable_nothing_in_alter.sql) (in query: alter table v modify query select NULL as x from src;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000b49848c
6. /build/src/Storages/StorageFactory.cpp:30: DB::checkAllTypesAreAllowedInTable(DB::NamesAndTypesList const&) @ 0x000000001c36afab
7. /build/src/Storages/StorageMaterializedView.cpp:430: DB::StorageMaterializedView::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c427831
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
9. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
10. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
11. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
12. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
13. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
19. ? @ 0x00007f7a996d8ac3
20. ? @ 0x00007f7a9976a850

2025.03.05 22:25:01.114058 [ 3777 ] {b7afb037-630e-4218-b3ca-c5f248d4745d} <Error> TCPHandler: Code: 370. DB::Exception: Data type Nullable(Nothing) of column 'x' cannot be used in tables. (DATA_TYPE_CANNOT_BE_USED_IN_TABLES), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String const&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String const&>::type>, String&&, String const&) @ 0x000000000b49848c
6. /build/src/Storages/StorageFactory.cpp:30: DB::checkAllTypesAreAllowedInTable(DB::NamesAndTypesList const&) @ 0x000000001c36afab
7. /build/src/Storages/StorageMaterializedView.cpp:430: DB::StorageMaterializedView::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c427831
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
9. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
10. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
11. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
12. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
13. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
19. ? @ 0x00007f7a996d8ac3
20. ? @ 0x00007f7a9976a850

2025.03.05 22:25:12.261512 [ 2811 ] {bc4886e7-e3ec-4e93-82e5-8534ae6dd466} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42066) (comment: 00151_order_by_read_in_order.sql) (in query: SELECT CounterID FROM test.hits ORDER BY CounterID DESC LIMIT 50;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:25:12.568164 [ 2811 ] {bc4886e7-e3ec-4e93-82e5-8534ae6dd466} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:25:13.661799 [ 2809 ] {8c39a722-c6e2-4eb1-b500-682b47e54303} <Error> Context: An error has occurred while reloading storage policies, storage policies were not applied: volume_priority values must be unique across the policy
2025.03.05 22:25:13.858704 [ 3828 ] {aab30763-473a-4ce9-9e9f-200d78adc234} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54090) (comment: 00148_monotonic_functions_and_index.sql) (in query: SELECT count() FROM test.hits WHERE -abs(CounterID) = -1731;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:25:13.872104 [ 3828 ] {aab30763-473a-4ce9-9e9f-200d78adc234} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:25:21.442740 [ 3828 ] {c0404eb6-067e-4dc6-94f3-7a784aac6f33} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=14, jobs=14). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38314) (comment: 00005_filtering.sql) (in query: SELECT count() FROM test.hits WHERE AdvEngineID != 0 ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:25:21.763474 [ 3828 ] {c0404eb6-067e-4dc6-94f3-7a784aac6f33} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=14, jobs=14). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:25:23.392859 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:25:23.686808 [ 3610 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:25:24.596403 [ 3633 ] {} <Error> void DB::SystemLog<DB::TraceLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38ea0
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:25:25.058141 [ 3828 ] {329ada02-3d76-432e-8e90-223f3879a26e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=807, jobs=779). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:41536) (comment: 03232_pr_not_ready_set.sql) (in query: SELECT `__table1`.`query_id` AS `query_id` FROM `system`.`query_log` AS `__table1` WHERE (`__table1`.`current_database` = _CAST('test_j4uqi3ti', 'String')) AND (`__table1`.`event_date` >= _CAST(20151, 'Date')) AND (`__table1`.`type` = 'QueryFinish') AND (`__table1`.`query` LIKE '-- Parallel inner query alone%')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:25:25.104095 [ 3828 ] {329ada02-3d76-432e-8e90-223f3879a26e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=807, jobs=779). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:25:25.285065 [ 2809 ] {91d48af2-ae88-4a38-aa2c-55968b94eefe} <Error> executeQuery: Code: 439. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: Cannot schedule a task: fault injected (threads=807, jobs=779). Stack trace:

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850
: While executing Remote. (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38318) (comment: 03232_pr_not_ready_set.sql) (in query: SELECT is_initial_query, count() AS c, replaceRegexpAll(query, '_data_(\\d+)_(\\d+)', '_data_') AS query FROM system.query_log WHERE (event_date >= yesterday()) AND (type = 'QueryFinish') AND (ignore(54, 0, ignore('QueryFinish', 11, toLowCardinality(toLowCardinality(11)), 11, 11, 11), 'QueryFinish', materialize(11), toUInt128(11)) IN ( SELECT query_id FROM system.query_log WHERE (current_database = currentDatabase()) AND (event_date >= yesterday()) AND (type = 'QueryFinish') AND (query LIKE '-- Parallel inner query alone%') )) GROUP BY is_initial_query, query ORDER BY is_initial_query ASC, c ASC, query ASC SETTINGS allow_experimental_parallel_reading_from_replicas=1, max_parallel_replicas=3, cluster_for_parallel_replicas='test_cluster_one_shard_three_replicas_localhost', parallel_replicas_for_non_replicated_merge_tree=1, parallel_replicas_min_number_of_rows_per_replica=10;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a941aaa
5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a941a55
6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013368d82
7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bca59
8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c3fb1
9. /build/src/Client/MultiplexedConnections.cpp:339: DB::MultiplexedConnections::receivePacketUnlocked(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>) @ 0x000000001d329078
10. /build/src/QueryPipeline/RemoteQueryExecutorReadContext.cpp:50: DB::RemoteQueryExecutorReadContext::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x0000000019ebe131
11. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000019ebcc69
12. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>::operator()(boost::context::fiber&&) @ 0x0000000019ebcb78
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebcb08
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebcac8
15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run(void*) @ 0x0000000019ebc9fe
16. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry<boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(boost::context::detail::transfer_t) @ 0x0000000019ebc71d

2025.03.05 22:25:25.336022 [ 2809 ] {91d48af2-ae88-4a38-aa2c-55968b94eefe} <Error> TCPHandler: Code: 439. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: Cannot schedule a task: fault injected (threads=807, jobs=779). Stack trace:

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850
: While executing Remote. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a941aaa
5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a941a55
6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013368d82
7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bca59
8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c3fb1
9. /build/src/Client/MultiplexedConnections.cpp:339: DB::MultiplexedConnections::receivePacketUnlocked(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>) @ 0x000000001d329078
10. /build/src/QueryPipeline/RemoteQueryExecutorReadContext.cpp:50: DB::RemoteQueryExecutorReadContext::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x0000000019ebe131
11. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000019ebcc69
12. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>::operator()(boost::context::fiber&&) @ 0x0000000019ebcb78
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebcb08
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebcac8
15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run(void*) @ 0x0000000019ebc9fe
16. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry<boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(boost::context::detail::transfer_t) @ 0x0000000019ebc71d

2025.03.05 22:25:27.649363 [ 3828 ] {1eb464ed-da00-41e6-8f79-7f0d48db7beb} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=11): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50484) (comment: 00055_index_and_not.sql) (in query: SELECT count() FROM test.hits WHERE NOT (EventDate >= toDate('2015-01-01') AND EventDate < toDate('2015-02-01')) ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:25:28.392302 [ 3776 ] {c61eaf28-eb73-498c-8171-62baa0d63e70} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50488) (comment: 01622_codec_zstd_long.sql) (in query: INSERT INTO words SELECT * FROM generateRandom('i Int, word String',1,10) LIMIT 1 BY i LIMIT 10000;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:25:28.392643 [ 3828 ] {1eb464ed-da00-41e6-8f79-7f0d48db7beb} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=11): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:25:28.518982 [ 3776 ] {c61eaf28-eb73-498c-8171-62baa0d63e70} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:25:32.318347 [ 3828 ] {2fa6b01d-c42d-4c7b-8083-1933f1dd8aa7} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50512) (comment: 00048_min_max.sql) (in query: SELECT min(EventDate), max(EventDate) FROM test.hits ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:25:32.356198 [ 3828 ] {2fa6b01d-c42d-4c7b-8083-1933f1dd8aa7} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:25:32.548596 [ 2811 ] {ba8112a9-3217-43f3-8919-e919ce62f474} <Error> Context: An error has occurred while reloading storage policies, storage policies were not applied: volume_priority values must cover the range from 1 to N (lowest priority specified) without gaps
2025.03.05 22:25:33.663375 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:25:33.724177 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:25:35.726457 [ 3776 ] {c238bf92-a7d4-4379-b257-bca41da41f06} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50504) (comment: 03231_pr_duplicate_announcement.sql) (in query: INSERT INTO test_table VALUES ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:43: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce46f4
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:320: DB::ReplicatedMergeTreeSinkImpl<false>::consume(DB::Chunk) @ 0x000000001d0a2220
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975

2025.03.05 22:25:36.119548 [ 3776 ] {c238bf92-a7d4-4379-b257-bca41da41f06} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:43: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce46f4
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:320: DB::ReplicatedMergeTreeSinkImpl<false>::consume(DB::Chunk) @ 0x000000001d0a2220
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975

2025.03.05 22:25:38.987695 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:25:39.241243 [ 2809 ] {d6f4778b-5ac5-463f-86c7-679eca1bbc5b} <Error> executeQuery: Code: 53. DB::Exception: Function dictGetString dictionary attribute has different type Nullable(String) expected String: In scope SELECT dictGetString('02125_test_dictionary', 'value', toUInt64(0)). (TYPE_MISMATCH) (version 24.3.12.76.altinitystable) (from [::1]:34068) (comment: 02125_dict_get_type_nullable_fix.sql) (in query: SELECT dictGetString('02125_test_dictionary', 'value', toUInt64(0));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000aa266a8
6. /build/src/Functions/FunctionsExternalDictionaries.h:855: DB::FunctionDictGetImpl<DB::DataTypeString, DB::NameDictGetString, (DB::DictionaryGetFunctionType)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000b035728
7. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
8. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
9. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
10. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
11. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
12. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
13. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
21. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
24. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
25. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d

2025.03.05 22:25:39.244561 [ 2809 ] {d6f4778b-5ac5-463f-86c7-679eca1bbc5b} <Error> TCPHandler: Code: 53. DB::Exception: Function dictGetString dictionary attribute has different type Nullable(String) expected String: In scope SELECT dictGetString('02125_test_dictionary', 'value', toUInt64(0)). (TYPE_MISMATCH), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000aa266a8
6. /build/src/Functions/FunctionsExternalDictionaries.h:855: DB::FunctionDictGetImpl<DB::DataTypeString, DB::NameDictGetString, (DB::DictionaryGetFunctionType)0>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000b035728
7. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
8. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
9. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
10. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
11. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
12. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
13. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
21. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
24. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
25. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d

2025.03.05 22:25:42.308666 [ 3776 ] {a2c93e5e-2d35-4bf2-8d37-2dcde38f5f97} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 16.98 MiB (attempt to allocate chunk of 1444662 bytes), maximum: 9.31 GiB: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/1ac/1acd413c-abb9-47e7-b5ab-2834f577d1ca/201403_7_13_1/ in table test.hits (1acd413c-abb9-47e7-b5ab-2834f577d1ca) located on disk s3_disk of type s3, from mark 150 with max_rows_to_read = 28830): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (MEMORY_LIMIT_EXCEEDED) (version 24.3.12.76.altinitystable) (from [::1]:34056) (comment: 00056_view.sql) (in query: SELECT count() FROM test.view;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000132e9d7a
6. /build/src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e7feb
7. /build/src/Common/MemoryTracker.cpp:398: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e8862
8. /build/src/Common/CurrentMemoryTracker.cpp:58: CurrentMemoryTracker::allocImpl(long, bool) @ 0x00000000132554f1
9. /build/src/Common/CurrentMemoryTracker.cpp:90: CurrentMemoryTracker::alloc(long) @ 0x0000000013255701
10. /build/src/Common/Allocator.cpp:114: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000132536e6
11. /build/src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x000000001335e8ec
12. /build/src/IO/BufferWithOwnMemory.h:87: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x000000001337d393
13. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:115: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x00000000193643da
14. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
15. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
22. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
23. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
25. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
26. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:134: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000001ce69b47
27. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:109: DB::MergeTreeRangeReader::DelayedStream::readRows(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, unsigned long) @ 0x000000001ce8370c
28. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:183: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000001ce839e4
29. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:295: DB::MergeTreeRangeReader::Stream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000001ce84305
30. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:1140: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000001ce8f091
31. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:1029: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000001ce8d52e

2025.03.05 22:25:43.486853 [ 3776 ] {a2c93e5e-2d35-4bf2-8d37-2dcde38f5f97} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 16.98 MiB (attempt to allocate chunk of 1444662 bytes), maximum: 9.31 GiB: (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/1ac/1acd413c-abb9-47e7-b5ab-2834f577d1ca/201403_7_13_1/ in table test.hits (1acd413c-abb9-47e7-b5ab-2834f577d1ca) located on disk s3_disk of type s3, from mark 150 with max_rows_to_read = 28830): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000132e9d7a
6. /build/src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e7feb
7. /build/src/Common/MemoryTracker.cpp:398: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e8862
8. /build/src/Common/CurrentMemoryTracker.cpp:58: CurrentMemoryTracker::allocImpl(long, bool) @ 0x00000000132554f1
9. /build/src/Common/CurrentMemoryTracker.cpp:90: CurrentMemoryTracker::alloc(long) @ 0x0000000013255701
10. /build/src/Common/Allocator.cpp:114: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000132536e6
11. /build/src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x000000001335e8ec
12. /build/src/IO/BufferWithOwnMemory.h:87: DB::Memory<Allocator<false, false>>::resize(unsigned long) @ 0x000000001337d393
13. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:115: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x00000000193643da
14. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
15. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
22. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
23. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
25. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
26. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:134: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000001ce69b47
27. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:109: DB::MergeTreeRangeReader::DelayedStream::readRows(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, unsigned long) @ 0x000000001ce8370c
28. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:183: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000001ce839e4
29. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:295: DB::MergeTreeRangeReader::Stream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000001ce84305
30. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:1140: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000001ce8f091
31. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:1029: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000001ce8d52e

2025.03.05 22:25:47.837795 [ 3776 ] {54b30178-2cbc-49ff-abde-aa8046a9e25c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36620) (comment: 00007_uniq.sql) (in query: SELECT RegionID, uniq(UserID) AS u FROM test.hits WHERE CounterID = 800784 GROUP BY RegionID ORDER BY u DESC, RegionID LIMIT 10 -- nothing
 ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:25:47.867871 [ 3776 ] {54b30178-2cbc-49ff-abde-aa8046a9e25c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:25:49.816184 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:25:50.188175 [ 3633 ] {} <Error> void DB::SystemLog<DB::TraceLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:25:55.341107 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:25:58.078834 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:26:00.378252 [ 3828 ] {43c1c445-ef27-4d84-82ac-d32a6f6290e4} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41928) (comment: 00940_max_parts_in_total.sql) (in query: INSERT INTO max_parts_in_total SELECT number FROM numbers(10);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d

2025.03.05 22:26:00.436118 [ 3828 ] {43c1c445-ef27-4d84-82ac-d32a6f6290e4} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d

2025.03.05 22:26:04.529324 [ 3953 ] {e4eece43-d431-471b-88cb-2563cd4931a5} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/agh/rzjdudteqzzilzscckqpeptyvpbpw, total size 89112385, count 89112385, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 717261fd-7474-46c6-86c5-6ed6fc99bcfc, upload has finished false.
2025.03.05 22:26:04.588495 [ 3953 ] {e4eece43-d431-471b-88cb-2563cd4931a5} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/agh/rzjdudteqzzilzscckqpeptyvpbpw, total size 89112385, count 89112385, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 717261fd-7474-46c6-86c5-6ed6fc99bcfc, upload has finished false
2025.03.05 22:26:04.636815 [ 3953 ] {e4eece43-d431-471b-88cb-2563cd4931a5} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/agh/rzjdudteqzzilzscckqpeptyvpbpw, total size 89112385, count 89112385, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 717261fd-7474-46c6-86c5-6ed6fc99bcfc, upload has finished false
2025.03.05 22:26:05.273726 [ 3923 ] {e4eece43-d431-471b-88cb-2563cd4931a5} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38282) (comment: 00162_mmap_compression_none.sql) (in query: INSERT INTO hits_none SELECT Title FROM test.hits;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6

2025.03.05 22:26:05.428069 [ 3923 ] {e4eece43-d431-471b-88cb-2563cd4931a5} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/jvt/qvlwczwdfoudvohqbtegsvhhqneyp, total size 99885443, count 99885443, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id f69ed994-aa8c-4d4d-946c-3804f8e1b4ca, upload has finished false.
2025.03.05 22:26:05.434910 [ 3923 ] {e4eece43-d431-471b-88cb-2563cd4931a5} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/jvt/qvlwczwdfoudvohqbtegsvhhqneyp, total size 99885443, count 99885443, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id f69ed994-aa8c-4d4d-946c-3804f8e1b4ca, upload has finished false
2025.03.05 22:26:05.563542 [ 3923 ] {e4eece43-d431-471b-88cb-2563cd4931a5} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/jvt/qvlwczwdfoudvohqbtegsvhhqneyp, total size 99885443, count 99885443, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id f69ed994-aa8c-4d4d-946c-3804f8e1b4ca, upload has finished false
2025.03.05 22:26:05.669514 [ 3923 ] {e4eece43-d431-471b-88cb-2563cd4931a5} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6

2025.03.05 22:26:20.038945 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {1c723b97-5f9d-496d-81d4-e674245041aa::202503_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:26:20.728063 [ 2811 ] {77872602-aa9b-4329-b3e4-3c9ea93df23f} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59362) (comment: 03230_anyHeavy_merge.sql) (in query: INSERT INTO t VALUES ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:43: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce46f4
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975

2025.03.05 22:26:20.738766 [ 2811 ] {77872602-aa9b-4329-b3e4-3c9ea93df23f} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:43: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce46f4
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975

2025.03.05 22:26:23.305885 [ 3828 ] {5d9ed080-adf4-4466-83fe-a210423f5d2c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:57124) (comment: 00091_prewhere_two_conditions.sql) (in query: SELECT uniq(URL) FROM test.hits WHERE toTimeZone(EventTime, 'Asia/Dubai') >= '2014-03-20 00:00:00' AND toTimeZone(EventTime, 'Asia/Dubai') < '2014-03-21 00:00:00' AND URL != '';), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:26:23.342621 [ 3828 ] {5d9ed080-adf4-4466-83fe-a210423f5d2c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:26:23.459434 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38ea0
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:26:24.692894 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:26:24.767519 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:26:28.531082 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:26:29.178609 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:26:31.645634 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:26:33.143246 [ 3923 ] {a56614c4-c132-4ae1-9373-a365bbae63f4} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42184) (comment: 00062_loyalty.sql) (in query: SELECT loyalty, count() AS c, bar(log(c + 1) * 1000, 0, log(6000) * 1000, 80) FROM (SELECT UserID, toInt8((yandex > google ? yandex / (yandex + google) : -google / (yandex + google)) * 10) AS loyalty FROM (SELECT UserID, sum(SearchEngineID = 2) AS yandex, sum(SearchEngineID = 3) AS google FROM test.hits WHERE SearchEngineID = 2 OR SearchEngineID = 3 GROUP BY UserID HAVING yandex + google > 10)) GROUP BY loyalty ORDER BY loyalty), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:26:33.718628 [ 3923 ] {a56614c4-c132-4ae1-9373-a365bbae63f4} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:26:33.921743 [ 3776 ] {1b520462-3be5-4579-9e91-321c02935a48} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=900, jobs=824). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42232) (comment: 03228_virtual_column_merge_dist.sql) (in query: SELECT `__table1`.`a` AS `a`, `__table1`.`_database` = _CAST('test_kzna56vd', 'String') AS `equals(_database, currentDatabase())` FROM `test_kzna56vd`.`t_merge` AS `__table1` ORDER BY `__table1`.`a` ASC), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:26:33.964180 [ 3776 ] {1b520462-3be5-4579-9e91-321c02935a48} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=900, jobs=824). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:26:34.322580 [ 3828 ] {2d252a34-cc22-4a3d-b2d7-4a4e5fd4ca2b} <Error> executeQuery: Code: 439. DB::Exception: Received from localhost:9000. DB::Exception: Cannot schedule a task: fault injected (threads=900, jobs=824). Stack trace:

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850
: While executing Remote. (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42178) (comment: 03228_virtual_column_merge_dist.sql) (in query: SELECT a, _database = currentDatabase() FROM t_distr ORDER BY a;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a941aaa
5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a941a55
6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013368d82
7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bca59
8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c3fb1
9. /build/src/Client/PacketReceiver.cpp:66: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000001d330ea4
10. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000019ebcc69
11. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>::operator()(boost::context::fiber&&) @ 0x0000000019ebcb78
12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebcb08
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebcac8
14. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run(void*) @ 0x0000000019ebc9fe
15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry<boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(boost::context::detail::transfer_t) @ 0x0000000019ebc71d

2025.03.05 22:26:34.329259 [ 3828 ] {2d252a34-cc22-4a3d-b2d7-4a4e5fd4ca2b} <Error> TCPHandler: Code: 439. DB::Exception: Received from localhost:9000. DB::Exception: Cannot schedule a task: fault injected (threads=900, jobs=824). Stack trace:

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850
: While executing Remote. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a941aaa
5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a941a55
6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013368d82
7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bca59
8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c3fb1
9. /build/src/Client/PacketReceiver.cpp:66: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000001d330ea4
10. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000019ebcc69
11. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>::operator()(boost::context::fiber&&) @ 0x0000000019ebcb78
12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebcb08
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebcac8
14. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run(void*) @ 0x0000000019ebc9fe
15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry<boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(boost::context::detail::transfer_t) @ 0x0000000019ebc71d

2025.03.05 22:26:38.280091 [ 3828 ] {d6f1951f-fd91-488a-a5a0-63e148b6698c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41934) (comment: 00037_uniq_state_merge1.sql) (in query: SELECT k, any(u) AS u, uniqMerge(us) AS us FROM (SELECT domain(URL) AS k, uniq(UserID) AS u, uniqState(UserID) AS us FROM test.hits GROUP BY k) GROUP BY k ORDER BY u DESC, k ASC LIMIT 100 ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:26:38.304320 [ 3828 ] {d6f1951f-fd91-488a-a5a0-63e148b6698c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:26:39.106058 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fe5b5b83-eea3-482d-90c9-5c8d7754068a::202503_1_11_2}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:26:43.841924 [ 3780 ] {1d4b1f66-6090-4a09-832c-f4cad368d92c} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:43900). (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:43900) (comment: 00177_memory_bound_merging.sh) (in query: SELECT `__table1`.`URL` AS `URL`, `__table1`.`EventDate` AS `EventDate`, `__table1`.`URL` AS `max(URL)` FROM `test`.`hits` AS `__table1` WHERE (`__table1`.`CounterID` = 1704509) AND (`__table1`.`UserID` = 4322253409885123546) GROUP BY `__table1`.`CounterID`, `__table1`.`URL`, `__table1`.`EventDate` ORDER BY `__table1`.`URL` ASC, `__table1`.`EventDate` ASC LIMIT _CAST(10, 'UInt64'), _CAST(5, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e7844
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Server/TCPHandler.cpp:2217: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001d47c18f
9. /build/src/Server/TCPHandler.cpp:1084: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479faa
10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:26:44.260131 [ 4786 ] {d45513e0-fa3a-408e-91bf-c18a9a874f41} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:52890) (comment: 02421_type_json_empty_parts.sh) (in query: SELECT count() FROM t_json_empty_parts;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:26:44.465702 [ 4786 ] {d45513e0-fa3a-408e-91bf-c18a9a874f41} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:26:44.557180 [ 3780 ] {1d4b1f66-6090-4a09-832c-f4cad368d92c} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:43900). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e7844
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Server/TCPHandler.cpp:2253: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000001d485e55
9. /build/src/Server/TCPHandler.cpp:2330: DB::TCPHandler::sendLogs() @ 0x000000001d47abff
10. /build/src/Server/TCPHandler.cpp:693: DB::TCPHandler::runImpl() @ 0x000000001d4700c2
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:26:44.558930 [ 3780 ] {1d4b1f66-6090-4a09-832c-f4cad368d92c} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:43900). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e7844
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Server/TCPHandler.cpp:2217: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001d47c18f
9. /build/src/Server/TCPHandler.cpp:1084: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479faa
10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:26:44.562513 [ 3780 ] {1d4b1f66-6090-4a09-832c-f4cad368d92c} <Warning> TCPHandler: Client has gone away.
2025.03.05 22:26:45.245444 [ 3828 ] {53dfdcce-0c71-457c-820b-7f78bc2323d8} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41960) (comment: 03228_variant_permutation_issue.sql) (in query: select * from test final WHERE data is not null format Null;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:26:45.263632 [ 3828 ] {53dfdcce-0c71-457c-820b-7f78bc2323d8} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:26:46.159663 [ 4783 ] {5f2f26d3-0b16-4663-ae85-b8cc405a7849} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=10): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41974) (comment: 00040_aggregating_materialized_view.sql) (in query: CREATE MATERIALIZED VIEW test.basic_00040 ENGINE = AggregatingMergeTree(StartDate, (CounterID, StartDate), 8192) POPULATE AS SELECT CounterID, StartDate, sumState(Sign) AS Visits, uniqState(UserID) AS Users FROM test.visits GROUP BY CounterID, StartDate;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:26:47.172274 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:26:48.978440 [ 4783 ] {5f2f26d3-0b16-4663-ae85-b8cc405a7849} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=10): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:26:54.793433 [ 3119 ] {} <Error> test_15.sample_table_2 (fabe82d1-27e1-4348-be2e-1944349b7e9c): void DB::StorageReplicatedMergeTree::mutationsFinalizingTask(): Code: 242. DB::Exception: Table is in readonly mode (replica path: /clickhouse/02221_system_zookeeper_unrestricted_test_15/02221_system_zookeeper_unrestricted_2/replicas/1). (TABLE_IS_READ_ONLY), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a941e33
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:5578: DB::StorageReplicatedMergeTree::assertNotReadonly() const @ 0x000000001c4abc2e
7. /build/src/Storages/StorageReplicatedMergeTree.cpp:252: DB::StorageReplicatedMergeTree::getZooKeeperAndAssertNotReadonly() const @ 0x000000001c4abb2e
8. /build/src/Storages/StorageReplicatedMergeTree.cpp:3914: DB::StorageReplicatedMergeTree::mutationsFinalizingTask() @ 0x000000001c52970d
9. /build/src/Storages/StorageReplicatedMergeTree.cpp:354: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::RenamingRestrictions, bool)::$_4::operator()() const @ 0x000000001c5bd2b8
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001c5bd295
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001c5bd275
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001c5bd255
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c5bd21d
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
16. /build/src/Core/BackgroundSchedulePool.cpp:106: DB::BackgroundSchedulePoolTaskInfo::execute() @ 0x000000001993149d
17. /build/src/Core/BackgroundSchedulePool.cpp:304: DB::BackgroundSchedulePool::threadFunction() @ 0x0000000019934f06
18. /build/src/Core/BackgroundSchedulePool.cpp:170: DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0::operator()() const @ 0x0000000019935e18
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019935df5
20. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x0000000019935dd9
21. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&, std::tuple<>&>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&, std::tuple<>&) @ 0x0000000019935d3d
22. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, char const*)::$_0&&)::'lambda'()::operator()() @ 0x0000000019935c65
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019935bd5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x0000000019935bb5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019935b95
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019935b60
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
29. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
30. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
 (version 24.3.12.76.altinitystable)
2025.03.05 22:26:55.571899 [ 4783 ] {99894762-0f24-44db-8ffc-0e73996786fa} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:44030) (comment: 00031_array_enumerate_uniq.sql) (in query: SELECT UserID, arrayEnumerateUniq(groupArray(SearchPhrase)) AS arr FROM ( SELECT UserID, SearchPhrase FROM test.hits WHERE CounterID = 1704509 AND UserID IN ( SELECT UserID FROM test.hits WHERE notEmpty(SearchPhrase) AND CounterID = 1704509 GROUP BY UserID HAVING count() > 1 ) ORDER BY UserID, WatchID ) WHERE notEmpty(SearchPhrase) GROUP BY UserID HAVING length(arr) > 1 ORDER BY UserID LIMIT 20 ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:26:55.677468 [ 4783 ] {99894762-0f24-44db-8ffc-0e73996786fa} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:26:55.791563 [ 3604 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:26:59.946381 [ 4786 ] {8ce3e6f1-a154-4dea-bff8-027f0bc121af} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:52942) (comment: 03222_datetime64_small_value_const.sql) (in query: insert into shard_0.dt64_03222 values), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6

2025.03.05 22:26:59.970329 [ 4786 ] {8ce3e6f1-a154-4dea-bff8-027f0bc121af} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6

2025.03.05 22:27:00.378390 [ 3828 ] {014413d0-89b8-4453-a283-f12545ef1327} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:44064) (comment: 00045_uniq_upto.sql) (in query: SELECT RegionID, uniqExact(UserID) AS u1, uniqUpTo(10)(UserID) AS u2 FROM test.visits GROUP BY RegionID HAVING u1 <= 11 AND u1 != u2), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:27:00.417325 [ 3828 ] {014413d0-89b8-4453-a283-f12545ef1327} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:27:01.305325 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:03.955445 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:04.401124 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column Referer): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_2_2_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 40 with max_rows_to_read = 6592): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:04.975594 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {09669507-4528-4e20-b87c-26ebd7ba8c50::202503_1_15_3}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:05.255043 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {09669507-4528-4e20-b87c-26ebd7ba8c50::202503_1_15_3}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:05.356890 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:07.795500 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {9f912096-7afb-496b-86c7-16abf59bb4e4::202503_1_15_3}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:09.011574 [ 3541 ] {0467ba8e-6ac0-4066-b881-0c526aa95fd8::2_2_2_0_3} <Error> MutatePlainMergeTreeTask: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable)
2025.03.05 22:27:09.018826 [ 3541 ] {0467ba8e-6ac0-4066-b881-0c526aa95fd8::2_2_2_0_3} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:09.269378 [ 3780 ] {92bf61ff-c570-4018-87d1-10d94f033d0f} <Error> executeQuery: Code: 341. DB::Exception: Exception happened during execution of mutation 'mutation_3.txt' with part '2_2_2_0' reason: 'Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable)'. This error maybe retryable or not. In case of unretryable error, mutation can be killed with KILL MUTATION query. (UNFINISHED) (version 24.3.12.76.altinitystable) (from [::1]:51820) (comment: 03221_mutation_analyzer_skip_part.sql) (in query: ALTER TABLE t_mutate_skip_part UPDATE v1 = 1000 WHERE key = 1;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, String, String&, String&>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<String&>::type, std::type_identity<String&>::type>, char const*&&, String&&, String&, String&) @ 0x000000001ce26c04
6. /build/src/Storages/MergeTree/MergeTreeMutationStatus.cpp:26: DB::checkMutationStatus(std::optional<DB::MergeTreeMutationStatus>&, std::set<String, std::less<String>, std::allocator<String>> const&) @ 0x000000001ce269a0
7. /build/src/Storages/StorageMergeTree.cpp:620: DB::StorageMergeTree::waitForMutation(long, String const&, bool) @ 0x000000001d0f2012
8. /build/src/Storages/StorageMergeTree.cpp:590: DB::StorageMergeTree::waitForMutation(long, bool) @ 0x000000001d0ef668
9. /build/src/Storages/StorageMergeTree.cpp:661: DB::StorageMergeTree::mutate(DB::MutationCommands const&, std::shared_ptr<DB::Context const>) @ 0x000000001d0f3869
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:221: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9600
11. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
12. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
21. ? @ 0x00007f7a996d8ac3
22. ? @ 0x00007f7a9976a850

2025.03.05 22:27:09.403728 [ 3780 ] {92bf61ff-c570-4018-87d1-10d94f033d0f} <Error> TCPHandler: Code: 341. DB::Exception: Exception happened during execution of mutation 'mutation_3.txt' with part '2_2_2_0' reason: 'Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable)'. This error maybe retryable or not. In case of unretryable error, mutation can be killed with KILL MUTATION query. (UNFINISHED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, String, String&, String&>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<String&>::type, std::type_identity<String&>::type>, char const*&&, String&&, String&, String&) @ 0x000000001ce26c04
6. /build/src/Storages/MergeTree/MergeTreeMutationStatus.cpp:26: DB::checkMutationStatus(std::optional<DB::MergeTreeMutationStatus>&, std::set<String, std::less<String>, std::allocator<String>> const&) @ 0x000000001ce269a0
7. /build/src/Storages/StorageMergeTree.cpp:620: DB::StorageMergeTree::waitForMutation(long, String const&, bool) @ 0x000000001d0f2012
8. /build/src/Storages/StorageMergeTree.cpp:590: DB::StorageMergeTree::waitForMutation(long, bool) @ 0x000000001d0ef668
9. /build/src/Storages/StorageMergeTree.cpp:661: DB::StorageMergeTree::mutate(DB::MutationCommands const&, std::shared_ptr<DB::Context const>) @ 0x000000001d0f3869
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:221: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9600
11. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
12. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
21. ? @ 0x00007f7a996d8ac3
22. ? @ 0x00007f7a9976a850

2025.03.05 22:27:09.641548 [ 3545 ] {0467ba8e-6ac0-4066-b881-0c526aa95fd8::2_2_2_0_3} <Error> MutatePlainMergeTreeTask: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable)
2025.03.05 22:27:09.659715 [ 3545 ] {0467ba8e-6ac0-4066-b881-0c526aa95fd8::2_2_2_0_3} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:09.665288 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:09.821282 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_2_2_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 1 with max_rows_to_read = 6592): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:12.444527 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_2_2_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6592): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:12.896233 [ 4786 ] {f35b8ced-f2c1-4c83-9579-e33b0be39558} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=30, jobs=28). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51824) (comment: 00072_compare_date_and_string_index.sql) (in query: SELECT count() FROM test.hits WHERE EventDate = '2014-03-18';), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:27:15.225178 [ 4786 ] {f35b8ced-f2c1-4c83-9579-e33b0be39558} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=30, jobs=28). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:27:15.806737 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:17.271240 [ 4789 ] {6a8c6a57-b2eb-460f-a663-542b1533edcc} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37108) (comment: 02482_execute_functions_before_sorting_bug.sql) (in query: select x + (1e10 + 1e20) from test order by (1e10 + 1e20), x;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:27:17.304099 [ 4789 ] {6a8c6a57-b2eb-460f-a663-542b1533edcc} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:27:19.428442 [ 3780 ] {ff0ff3df-c835-4d48-8f15-df4cfedecd81} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37124) (comment: 00021_2_select_with_in.sql) (in query: select sum(Sign) from test.visits where CounterID in (942285, 577322);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:27:19.455509 [ 3780 ] {ff0ff3df-c835-4d48-8f15-df4cfedecd81} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:27:23.047032 [ 3780 ] {7b02deea-e3be-4447-8ad8-69bdc0dbabae} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37140) (comment: 00979_set_index_not.sql) (in query: CREATE TABLE set_index_not (`name` String, `status` Enum8('alive' = 0, 'rip' = 1), INDEX idx_status status TYPE set(2) GRANULARITY 1) ENGINE = MergeTree ORDER BY name SETTINGS index_granularity = 8192, min_bytes_for_wide_part = 375984602, ratio_of_defaults_for_sparse_serialization = 0., replace_long_file_name_to_hash = false, max_file_name_length = 12, min_bytes_for_full_part_storage = 0, compact_parts_max_bytes_to_buffer = 197697077, compact_parts_max_granules_to_buffer = 207, compact_parts_merge_max_bytes_to_prefetch_part = 31306059, merge_max_block_size = 11547, old_parts_lifetime = 295., prefer_fetch_merged_part_size_threshold = 8389687355, vertical_merge_algorithm_min_rows_to_activate = 699464, vertical_merge_algorithm_min_columns_to_activate = 16, min_merge_bytes_to_use_direct_io = 10737418240, index_granularity_bytes = 31296542, concurrent_part_removal_threshold = 100, allow_vertical_merges_from_compact_to_wide_parts = false, cache_populated_by_fetch = true, marks_compress_block_size = 74549, primary_key_compress_block_size = 14938), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:169: DB::ThreadPoolCallbackRunnerLocal<void, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>, std::function<void ()>>::operator()(std::function<void ()>&&, Priority) @ 0x0000000018f67c7a
10. /build/src/Storages/MergeTree/MergeTreeData.cpp:1703: DB::MergeTreeData::loadDataParts(bool, std::optional<std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>>) @ 0x000000001cbc5677
11. /build/src/Storages/StorageMergeTree.cpp:120: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>) @ 0x000000001d0ea014
12. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageMergeTree* std::construct_at[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::StorageMergeTree*>(DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e99b7
13. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageMergeTree>>::construct[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void, void>(std::allocator<DB::StorageMergeTree>&, DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e96c7
14. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>>(std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e9375
15. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e91a7
16. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageMergeTree> std::make_shared[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e636d
17. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:741: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e3eaa
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019306cfd
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x0000000019306cbd
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019306c7d
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019306c45
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
24. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
25. /build/src/Interpreters/InterpreterCreateQuery.cpp:1493: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x000000001b01d20c
26. /build/src/Interpreters/InterpreterCreateQuery.cpp:1313: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b017166
27. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe96
28. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
29. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
30. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
31. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5

2025.03.05 22:27:23.080653 [ 3780 ] {7b02deea-e3be-4447-8ad8-69bdc0dbabae} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:169: DB::ThreadPoolCallbackRunnerLocal<void, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>, std::function<void ()>>::operator()(std::function<void ()>&&, Priority) @ 0x0000000018f67c7a
10. /build/src/Storages/MergeTree/MergeTreeData.cpp:1703: DB::MergeTreeData::loadDataParts(bool, std::optional<std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>>) @ 0x000000001cbc5677
11. /build/src/Storages/StorageMergeTree.cpp:120: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>) @ 0x000000001d0ea014
12. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageMergeTree* std::construct_at[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::StorageMergeTree*>(DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e99b7
13. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageMergeTree>>::construct[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void, void>(std::allocator<DB::StorageMergeTree>&, DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e96c7
14. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>>(std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e9375
15. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e91a7
16. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageMergeTree> std::make_shared[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e636d
17. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:741: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e3eaa
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019306cfd
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x0000000019306cbd
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019306c7d
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019306c45
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
24. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
25. /build/src/Interpreters/InterpreterCreateQuery.cpp:1493: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x000000001b01d20c
26. /build/src/Interpreters/InterpreterCreateQuery.cpp:1313: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b017166
27. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe96
28. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
29. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
30. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
31. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5

2025.03.05 22:27:24.421349 [ 4789 ] {f1fbfef5-960e-4304-8f8c-c0de3b85735a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=935, jobs=839). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47924) (comment: 00160_decode_xml_component.sql) (in query: SELECT sum(DISTINCT sipHash64(decodeXMLComponent(Title) AS decoded)) FROM test.hits WHERE Title != decoded;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:27:24.600742 [ 4789 ] {f1fbfef5-960e-4304-8f8c-c0de3b85735a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=935, jobs=839). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:27:24.623003 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:25.577309 [ 3604 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:32.135024 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38ea0
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:34.916039 [ 4786 ] {5c63c0dc-ba4a-44ef-a81f-1121dfbe5e10} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47938) (comment: 00531_aggregate_over_nullable.sql) (in query: SELECT arraySort(topK(3)(description)) FROM agg_over_nullable;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:27:35.069487 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7a26c9c9-7195-4e8c-807c-8ccd93ff5af2::202503_1_15_3}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:35.078510 [ 4786 ] {5c63c0dc-ba4a-44ef-a81f-1121dfbe5e10} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:27:35.137262 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:36.095500 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:36.223741 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:36.536866 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:36.681173 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7a26c9c9-7195-4e8c-807c-8ccd93ff5af2::202503_11_16_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:38.280573 [ 2811 ] {92251e9d-0d05-44bb-afe0-5480bd2a8126} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:52918) (comment: 00177_memory_bound_merging.sh) (in query: SELECT COUNT() > 0 FROM system.text_log WHERE query_id IN (SELECT query_id FROM system.query_log WHERE query_id != 'query_id_memory_bound_merging_1856012064' AND initial_query_id = 'query_id_memory_bound_merging_1856012064' AND event_date >= yesterday()) AND event_date >= yesterday() AND message ILIKE '%Reading%ranges in order%'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:27:38.428279 [ 2811 ] {92251e9d-0d05-44bb-afe0-5480bd2a8126} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:27:40.247861 [ 3581 ] {} <Warning> test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92): Removing temporary directory /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/tmp_merge_201403_1_6_1/
2025.03.05 22:27:40.248594 [ 3581 ] {} <Warning> test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/tmp_merge_201403_1_6_1/
2025.03.05 22:27:40.258263 [ 4789 ] {34842eb2-c9c0-4418-9e58-c80339675eca} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=18, jobs=18). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:58792) (comment: 02122_parallel_formatting_JSONStringsEachRow.sh) (in query: select number, number + 1, concat('string: ', toString(number)) from numbers(200000) group by number with totals order by number limit 190000 format JSONStringsEachRow), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:27:40.352261 [ 4789 ] {34842eb2-c9c0-4418-9e58-c80339675eca} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=18, jobs=18). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:27:40.675052 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=1): (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_4_4_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 19 with max_rows_to_read = 6741): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:41.555880 [ 4789 ] {8311249e-c45d-4e92-a2a7-5c9b354f45ef} <Error> executeQuery: Code: 43. DB::Exception: Argument 'max_width' must not be NaN: In scope SELECT bar((greatCircleAngle(65537, 2, 1, 1) - 1) * 65535, 1048576, 1048577, nan). (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:58804) (comment: 01621_bar_nan_arguments.sql) (in query: SELECT bar((greatCircleAngle(65537, 2, 1, 1) - 1) * 65535, 1048576, 1048577, nan);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Functions/bar.cpp:86: DB::(anonymous namespace)::FunctionBar::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ba8db61
7. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
8. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
9. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
10. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
11. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
12. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
13. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
21. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
24. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
25. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d

2025.03.05 22:27:41.570413 [ 4789 ] {8311249e-c45d-4e92-a2a7-5c9b354f45ef} <Error> TCPHandler: Code: 43. DB::Exception: Argument 'max_width' must not be NaN: In scope SELECT bar((greatCircleAngle(65537, 2, 1, 1) - 1) * 65535, 1048576, 1048577, nan). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Functions/bar.cpp:86: DB::(anonymous namespace)::FunctionBar::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ba8db61
7. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
8. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
9. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
10. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
11. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
12. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
13. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
21. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
24. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
25. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d

2025.03.05 22:27:41.696287 [ 4789 ] {271e31b1-c917-4e26-9c8a-2149c6ccfb6a} <Error> executeQuery: Code: 43. DB::Exception: Argument 'max_width' must not be NaN: In scope SELECT bar(1, 1, 1, nan). (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:58804) (comment: 01621_bar_nan_arguments.sql) (in query: select bar(1,1,1,nan);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Functions/bar.cpp:86: DB::(anonymous namespace)::FunctionBar::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ba8db61
7. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
8. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
9. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
10. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
11. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
12. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
13. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
21. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
24. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
25. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d

2025.03.05 22:27:41.708520 [ 4789 ] {271e31b1-c917-4e26-9c8a-2149c6ccfb6a} <Error> TCPHandler: Code: 43. DB::Exception: Argument 'max_width' must not be NaN: In scope SELECT bar(1, 1, 1, nan). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Functions/bar.cpp:86: DB::(anonymous namespace)::FunctionBar::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ba8db61
7. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
8. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
9. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
10. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
11. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
12. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
13. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
21. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
24. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
25. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d

2025.03.05 22:27:42.120680 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:42.200636 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {0d6617f8-564f-43ff-a6dc-a74b9f150261::202503_1_16_3}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:44.756760 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/bbx/zqahkhxjuglbvskviukkxxrsogpwo, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id d7df4971-d963-4697-b6d8-4a7f405f6897, upload has finished false.
2025.03.05 22:27:44.767017 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/bbx/zqahkhxjuglbvskviukkxxrsogpwo, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id d7df4971-d963-4697-b6d8-4a7f405f6897, upload has finished false
2025.03.05 22:27:44.831354 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/bbx/zqahkhxjuglbvskviukkxxrsogpwo, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id d7df4971-d963-4697-b6d8-4a7f405f6897, upload has finished false
2025.03.05 22:27:44.974065 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 26 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:47.120868 [ 3923 ] {188b4c9b-63f1-4fff-be26-3fbdcbd3c71a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=2): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:51818) (comment: 02725_memory-for-merges.sql) (in query: OPTIMIZE TABLE 02725_memory_for_merges FINAL;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710

2025.03.05 22:27:47.174057 [ 3923 ] {188b4c9b-63f1-4fff-be26-3fbdcbd3c71a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=2): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710

2025.03.05 22:27:47.213171 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:47.774250 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:51.042610 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:53.520062 [ 4786 ] {368e6b3a-f2e9-442e-ab3b-8f74d61e5b29} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55326) (comment: 02004_intersect_except_const_column.sql) (in query: SELECT toString(1) FROM numbers(10) INTERSECT DISTINCT SELECT toString(1) FROM numbers(10);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:27:53.552389 [ 4786 ] {368e6b3a-f2e9-442e-ab3b-8f74d61e5b29} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:27:55.677744 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:57.171961 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:27:59.884479 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:01.541406 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/elh/rqwizxcdnakxfilhslituooumdmkw, total size 184549376, count 184549376, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id de9edd24-ddf9-4b7b-8cda-abd50f722ba9, upload has finished false.
2025.03.05 22:28:01.543591 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/elh/rqwizxcdnakxfilhslituooumdmkw, total size 184549376, count 184549376, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id de9edd24-ddf9-4b7b-8cda-abd50f722ba9, upload has finished false
2025.03.05 22:28:01.645513 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/elh/rqwizxcdnakxfilhslituooumdmkw, total size 184549376, count 184549376, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id de9edd24-ddf9-4b7b-8cda-abd50f722ba9, upload has finished false
2025.03.05 22:28:01.763489 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 40 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:02.799037 [ 3780 ] {8a44b190-6031-449a-b180-91a16654b8b6} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:35388) (comment: 01018_empty_aggregation_filling.sql) (in query: SELECT stddevSampOrDefaultIf(x, x > 1) FROM (SELECT 1 AS x);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:28:02.832282 [ 3780 ] {8a44b190-6031-449a-b180-91a16654b8b6} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:28:04.213718 [ 3610 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:05.325256 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:06.907462 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:08.262969 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:08.742645 [ 3828 ] {52b36ffa-3461-49eb-b4fb-350569aad4ea} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37100) (comment: 03217_filtering_in_system_tables.sql) (in query: -- StorageSystemReplicas
 SELECT argMax(read_rows, event_time_microseconds) FROM system.query_log WHERE 1 AND current_database = currentDatabase() AND query LIKE '%SELECT database, table, left(replica_name, 2) FROM system.replicas WHERE database = currentDatabase() AND table = \'test_03217_system_tables_replica_1\' AND replica_name LIKE \'r1\%\';' AND type = 'QueryFinish';), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:28:08.791219 [ 3828 ] {52b36ffa-3461-49eb-b4fb-350569aad4ea} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:28:15.443859 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column IsNew): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_3_3_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6608): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:17.126187 [ 3923 ] {677bfaca-f752-4193-8699-fd67cdff5cc5} <Error> executeQuery: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 1000000)). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:57414) (comment: 03217_json_merge_patch_stack_overflow.sql) (in query: SELECT JSONMergePatch(REPEAT('{"c":', 1000000));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type>, char const*&&) @ 0x000000000ece59b3
6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece1e58
7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ece1380
8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:28:17.130115 [ 3923 ] {677bfaca-f752-4193-8699-fd67cdff5cc5} <Error> TCPHandler: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 1000000)). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type>, char const*&&) @ 0x000000000ece59b3
6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece1e58
7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ece1380
8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:28:17.388376 [ 3923 ] {dc0ec8d7-ff10-409b-a4d0-c29e0c28d289} <Error> executeQuery: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 100000)). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:57414) (comment: 03217_json_merge_patch_stack_overflow.sql) (in query: SELECT JSONMergePatch(REPEAT('{"c":', 100000));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type>, char const*&&) @ 0x000000000ece59b3
6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece1e58
7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ece1380
8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:28:17.402208 [ 3923 ] {dc0ec8d7-ff10-409b-a4d0-c29e0c28d289} <Error> TCPHandler: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 100000)). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type>, char const*&&) @ 0x000000000ece59b3
6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece1e58
7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ece1380
8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:28:17.692237 [ 3923 ] {433b3c35-2476-4152-ad4d-5c1216cf2dc8} <Error> executeQuery: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 10000)). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:57414) (comment: 03217_json_merge_patch_stack_overflow.sql) (in query: SELECT JSONMergePatch(REPEAT('{"c":', 10000));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type>, char const*&&) @ 0x000000000ece59b3
6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece1e58
7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ece1380
8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:28:17.708705 [ 3923 ] {433b3c35-2476-4152-ad4d-5c1216cf2dc8} <Error> TCPHandler: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 10000)). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type>, char const*&&) @ 0x000000000ece59b3
6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece1e58
7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ece1380
8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:28:17.865101 [ 3923 ] {6527f729-35bf-4551-8038-41b08c0575f6} <Error> executeQuery: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 1000)). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:57414) (comment: 03217_json_merge_patch_stack_overflow.sql) (in query: SELECT JSONMergePatch(REPEAT('{"c":', 1000));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type>, char const*&&) @ 0x000000000ece59b3
6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece1e58
7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ece1380
8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:28:17.874451 [ 3923 ] {6527f729-35bf-4551-8038-41b08c0575f6} <Error> TCPHandler: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 1000)). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type>, char const*&&) @ 0x000000000ece59b3
6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece1e58
7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ece1380
8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:28:17.955929 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/hmr/cnzofhfyxztjripsezhsluaklbrgf, total size 234881024, count 234881024, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 20d6cbd5-049a-4dec-a843-6a424b36a12a, upload has finished false.
2025.03.05 22:28:17.957662 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/hmr/cnzofhfyxztjripsezhsluaklbrgf, total size 234881024, count 234881024, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 20d6cbd5-049a-4dec-a843-6a424b36a12a, upload has finished false
2025.03.05 22:28:18.025424 [ 3923 ] {ee473919-046a-4dd2-9101-5ba354a55f6b} <Error> executeQuery: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 100)). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:57414) (comment: 03217_json_merge_patch_stack_overflow.sql) (in query: SELECT JSONMergePatch(REPEAT('{"c":', 100));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type>, char const*&&) @ 0x000000000ece59b3
6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece1e58
7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ece1380
8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:28:18.030549 [ 3923 ] {ee473919-046a-4dd2-9101-5ba354a55f6b} <Error> TCPHandler: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 100)). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type>, char const*&&) @ 0x000000000ece59b3
6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece1e58
7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ece1380
8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:28:18.050643 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/hmr/cnzofhfyxztjripsezhsluaklbrgf, total size 234881024, count 234881024, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 20d6cbd5-049a-4dec-a843-6a424b36a12a, upload has finished false
2025.03.05 22:28:18.120404 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 50 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:18.157392 [ 3923 ] {ac2abf9c-bc24-4f8a-a503-fcce73595be9} <Error> executeQuery: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 10)). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:57414) (comment: 03217_json_merge_patch_stack_overflow.sql) (in query: SELECT JSONMergePatch(REPEAT('{"c":', 10));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type>, char const*&&) @ 0x000000000ece59b3
6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece1e58
7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ece1380
8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:28:18.171518 [ 3923 ] {ac2abf9c-bc24-4f8a-a503-fcce73595be9} <Error> TCPHandler: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 10)). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type>, char const*&&) @ 0x000000000ece59b3
6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece1e58
7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ece1380
8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:28:18.251708 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:18.324210 [ 3923 ] {144e2757-af5c-4d86-baf2-d09fd1a6b6ef} <Error> executeQuery: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 1)). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:57414) (comment: 03217_json_merge_patch_stack_overflow.sql) (in query: SELECT JSONMergePatch(REPEAT('{"c":', 1));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type>, char const*&&) @ 0x000000000ece59b3
6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece1e58
7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ece1380
8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:28:18.348974 [ 3923 ] {144e2757-af5c-4d86-baf2-d09fd1a6b6ef} <Error> TCPHandler: Code: 36. DB::Exception: Wrong JSON string to merge: Invalid value.: In scope SELECT JSONMergePatch(REPEAT('{"c":', 1)). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type>, char const*&&) @ 0x000000000ece59b3
6. /build/src/Functions/jsonMergePatch.cpp:105: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const::'lambda'(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long)::operator()(DB::ColumnString const&, rapidjson::GenericDocument<rapidjson::UTF8<char>, rapidjson::MemoryPoolAllocator<rapidjson::CrtAllocator>, rapidjson::CrtAllocator>&, unsigned long) const @ 0x000000000ece1e58
7. /build/src/Functions/jsonMergePatch.cpp:128: DB::(anonymous namespace)::FunctionJSONMergePatch::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000ece1380
8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:28:23.989011 [ 3583 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Removing temporary directory /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:28:23.989912 [ 3583 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:28:24.019778 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:24.080462 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/yqq/evmjnswmijurodvvrencfvaedexat, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 71292e2f-6665-4bef-b673-c975a8b9a6ef, upload has finished false.
2025.03.05 22:28:24.081276 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/yqq/evmjnswmijurodvvrencfvaedexat, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 71292e2f-6665-4bef-b673-c975a8b9a6ef, upload has finished false
2025.03.05 22:28:24.101200 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/yqq/evmjnswmijurodvvrencfvaedexat, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 71292e2f-6665-4bef-b673-c975a8b9a6ef, upload has finished false
2025.03.05 22:28:24.154084 [ 3541 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 13 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:24.525663 [ 3780 ] {e23cf759-caa3-402e-b4ff-82af4be6ef34} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:44802) (comment: 02789_functions_after_sorting_and_columns_with_same_names_bug.sql) (in query: SELECT * FROM ( SELECT m0.pt ,m0.exposure_uv AS exposure_uv ,round(m2.exposure_uv,4) FROM ( SELECT pt ,exposure_uv FROM test1 ) m0 LEFT JOIN ( SELECT pt ,exposure_uv FROM test1 ) m1 ON m0.pt = m1.pt LEFT JOIN ( SELECT pt ,exposure_uv FROM test1 ) m2 ON m0.pt = m2.pt ) c0 ORDER BY exposure_uv settings join_use_nulls = 1;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:28:24.638819 [ 2811 ] {44177c88-946c-4400-be2a-30497e683bf1} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:57422) (comment: 00159_parallel_formatting_json_and_friends_1.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRow), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:28:24.767527 [ 3780 ] {e23cf759-caa3-402e-b4ff-82af4be6ef34} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:28:25.661533 [ 2811 ] {44177c88-946c-4400-be2a-30497e683bf1} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:28:27.484567 [ 3541 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 5 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:30.610165 [ 5819 ] {99ef32e4-4c40-44fd-95d1-28563d2abe1a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:32950) (comment: 00159_parallel_formatting_json_and_friends_1.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRow), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:28:30.891412 [ 5819 ] {99ef32e4-4c40-44fd-95d1-28563d2abe1a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:28:31.432174 [ 2929 ] {} <Error> void DB::StorageWindowView::threadFuncFireProc(): Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:32.546666 [ 3004 ] {} <Error> void DB::StorageWindowView::threadFuncFireProc(): Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:32.796131 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:34.019292 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/ddi/acsskegefqzaiyjwowtlemchondrq, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id fd385676-fd58-4177-9ca7-d3b2a4d373dd, upload has finished false.
2025.03.05 22:28:34.020336 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/ddi/acsskegefqzaiyjwowtlemchondrq, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id fd385676-fd58-4177-9ca7-d3b2a4d373dd, upload has finished false
2025.03.05 22:28:34.084194 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/ddi/acsskegefqzaiyjwowtlemchondrq, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id fd385676-fd58-4177-9ca7-d3b2a4d373dd, upload has finished false
2025.03.05 22:28:34.127245 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 15 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:36.940032 [ 5724 ] {1355bd33-3115-4c06-8094-57019a62b80b} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:35374) (comment: 00177_memory_bound_merging.sh) (in query: SELECT COUNT() > 0 FROM system.text_log WHERE query_id IN (SELECT query_id FROM system.query_log WHERE query_id != 'query_id_memory_bound_merging_666524393' AND initial_query_id = 'query_id_memory_bound_merging_666524393' AND event_date >= yesterday()) AND event_date >= yesterday() AND message ILIKE '%Reading%ranges in order%'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:28:37.240397 [ 5724 ] {1355bd33-3115-4c06-8094-57019a62b80b} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:28:39.877138 [ 5724 ] {cc044219-7c43-49af-8ddb-4f1a4c63bded} <Error> executeQuery: Code: 701. DB::Exception: Reading in parallel from replicas is enabled but cluster to execute query is not provided. Please set 'cluster_for_parallel_replicas' setting. (CLUSTER_DOESNT_EXIST) (version 24.3.12.76.altinitystable) (from [::1]:44652) (comment: 03215_analyzer_replace_with_dummy_tables.sql) (in query: SELECT 1 FROM ( SELECT number IN ( SELECT number FROM view( SELECT number FROM numbers(1) ) ) FROM t ) SETTINGS allow_experimental_parallel_reading_from_replicas = 1, max_parallel_replicas = 2, allow_experimental_analyzer = 1;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Interpreters/ClusterProxy/executeQuery.cpp:377: DB::ClusterProxy::executeQueryWithParallelReplicas(DB::QueryPlan&, DB::ClusterProxy::SelectStreamFactory&, std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, std::shared_ptr<std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const>) @ 0x000000001bd5e275
7. /build/src/Planner/findParallelReplicasQuery.cpp:423: DB::buildQueryPlanForParallelReplicas(DB::QueryNode const&, std::shared_ptr<DB::PlannerContext> const&, std::shared_ptr<std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const>) @ 0x000000001b541d5c
8. /build/src/Planner/Planner.cpp:1468: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50e259
9. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50a455
10. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50765d
11. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0e12
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:28:39.896683 [ 5724 ] {cc044219-7c43-49af-8ddb-4f1a4c63bded} <Error> TCPHandler: Code: 701. DB::Exception: Reading in parallel from replicas is enabled but cluster to execute query is not provided. Please set 'cluster_for_parallel_replicas' setting. (CLUSTER_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Interpreters/ClusterProxy/executeQuery.cpp:377: DB::ClusterProxy::executeQueryWithParallelReplicas(DB::QueryPlan&, DB::ClusterProxy::SelectStreamFactory&, std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, std::shared_ptr<std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const>) @ 0x000000001bd5e275
7. /build/src/Planner/findParallelReplicasQuery.cpp:423: DB::buildQueryPlanForParallelReplicas(DB::QueryNode const&, std::shared_ptr<DB::PlannerContext> const&, std::shared_ptr<std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const>) @ 0x000000001b541d5c
8. /build/src/Planner/Planner.cpp:1468: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50e259
9. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50a455
10. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50765d
11. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0e12
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:28:42.468069 [ 4789 ] {4f57cab4-b84a-4003-990b-6903529859a1} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=32, jobs=32). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:44808) (comment: 00688_low_cardinality_dictionary_deserialization.sql) (in query: select sum(toUInt64(str)), sum(toUInt64(pat)) from lc_dict_reading where val < 8129 or val > 8192 * 4;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:28:45.164014 [ 4789 ] {4f57cab4-b84a-4003-990b-6903529859a1} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=32, jobs=32). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:28:46.202665 [ 5808 ] {a8206325-7a7e-4631-a2a6-cfaf50c4ac76} <Error> executeQuery: Code: 44. DB::Exception: Cannot create column with type 'Variant(String, UInt32)' because experimental Variant type is not allowed. Set setting allow_experimental_variant_type = 1 in order to allow it. (ILLEGAL_COLUMN) (version 24.3.12.76.altinitystable) (from [::1]:49040) (comment: 03215_validate_type_in_alter_add_modify_column.sql) (in query: alter table test add column bad Variant(UInt32, String);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:71: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0cf6c
7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0c98d
8. /build/src/Storages/AlterCommands.cpp:1290: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c24ec80
9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:28:46.224177 [ 5808 ] {a8206325-7a7e-4631-a2a6-cfaf50c4ac76} <Error> TCPHandler: Code: 44. DB::Exception: Cannot create column with type 'Variant(String, UInt32)' because experimental Variant type is not allowed. Set setting allow_experimental_variant_type = 1 in order to allow it. (ILLEGAL_COLUMN), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:71: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0cf6c
7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0c98d
8. /build/src/Storages/AlterCommands.cpp:1290: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c24ec80
9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:28:46.904160 [ 5808 ] {68870e39-1ffd-4b49-be9c-dd8dd9772560} <Error> executeQuery: Code: 455. DB::Exception: Creating columns of type LowCardinality(UInt8) is prohibited by default due to expected negative impact on performance. It can be enabled with the "allow_suspicious_low_cardinality_types" setting. (SUSPICIOUS_TYPE_FOR_LOW_CARDINALITY) (version 24.3.12.76.altinitystable) (from [::1]:49040) (comment: 03215_validate_type_in_alter_add_modify_column.sql) (in query: alter table test add column bad LowCardinality(UInt8);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:33: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0cb4d
7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0c98d
8. /build/src/Storages/AlterCommands.cpp:1290: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c24ec80
9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:28:46.914499 [ 5808 ] {68870e39-1ffd-4b49-be9c-dd8dd9772560} <Error> TCPHandler: Code: 455. DB::Exception: Creating columns of type LowCardinality(UInt8) is prohibited by default due to expected negative impact on performance. It can be enabled with the "allow_suspicious_low_cardinality_types" setting. (SUSPICIOUS_TYPE_FOR_LOW_CARDINALITY), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:33: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0cb4d
7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0c98d
8. /build/src/Storages/AlterCommands.cpp:1290: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c24ec80
9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:28:47.266076 [ 5808 ] {ffa5b666-b3aa-40ec-b1cf-24c8a5100f93} <Error> executeQuery: Code: 44. DB::Exception: Cannot create column with type 'FixedString(10000)' because fixed string with size > 256 is suspicious. Set setting allow_suspicious_fixed_string_types = 1 in order to allow it. (ILLEGAL_COLUMN) (version 24.3.12.76.altinitystable) (from [::1]:49040) (comment: 03215_validate_type_in_alter_add_modify_column.sql) (in query: alter table test add column bad FixedString(10000);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, int>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<int>::type>, String&&, int&&) @ 0x000000001bc0e62c
6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:58: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0ce1d
7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0c98d
8. /build/src/Storages/AlterCommands.cpp:1290: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c24ec80
9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:28:47.282612 [ 5808 ] {ffa5b666-b3aa-40ec-b1cf-24c8a5100f93} <Error> TCPHandler: Code: 44. DB::Exception: Cannot create column with type 'FixedString(10000)' because fixed string with size > 256 is suspicious. Set setting allow_suspicious_fixed_string_types = 1 in order to allow it. (ILLEGAL_COLUMN), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, int>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<int>::type>, String&&, int&&) @ 0x000000001bc0e62c
6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:58: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0ce1d
7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0c98d
8. /build/src/Storages/AlterCommands.cpp:1290: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c24ec80
9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:28:47.652654 [ 5808 ] {d5bf24fa-2873-495e-8318-5d97b72f4c69} <Error> executeQuery: Code: 44. DB::Exception: Cannot create column with type 'Variant(String, UInt32)' because experimental Variant type is not allowed. Set setting allow_experimental_variant_type = 1 in order to allow it. (ILLEGAL_COLUMN) (version 24.3.12.76.altinitystable) (from [::1]:49040) (comment: 03215_validate_type_in_alter_add_modify_column.sql) (in query: alter table test modify column id Variant(UInt32, String);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:71: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0cf6c
7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0c98d
8. /build/src/Storages/AlterCommands.cpp:1372: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c250147
9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:28:47.672858 [ 5808 ] {d5bf24fa-2873-495e-8318-5d97b72f4c69} <Error> TCPHandler: Code: 44. DB::Exception: Cannot create column with type 'Variant(String, UInt32)' because experimental Variant type is not allowed. Set setting allow_experimental_variant_type = 1 in order to allow it. (ILLEGAL_COLUMN), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:71: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0cf6c
7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0c98d
8. /build/src/Storages/AlterCommands.cpp:1372: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c250147
9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:28:48.287048 [ 5808 ] {720c8804-3069-46b0-aff8-5e9b1bad79e5} <Error> executeQuery: Code: 455. DB::Exception: Creating columns of type LowCardinality(UInt8) is prohibited by default due to expected negative impact on performance. It can be enabled with the "allow_suspicious_low_cardinality_types" setting. (SUSPICIOUS_TYPE_FOR_LOW_CARDINALITY) (version 24.3.12.76.altinitystable) (from [::1]:49040) (comment: 03215_validate_type_in_alter_add_modify_column.sql) (in query: alter table test modify column id LowCardinality(UInt8);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:33: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0cb4d
7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0c98d
8. /build/src/Storages/AlterCommands.cpp:1372: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c250147
9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:28:48.317612 [ 5808 ] {720c8804-3069-46b0-aff8-5e9b1bad79e5} <Error> TCPHandler: Code: 455. DB::Exception: Creating columns of type LowCardinality(UInt8) is prohibited by default due to expected negative impact on performance. It can be enabled with the "allow_suspicious_low_cardinality_types" setting. (SUSPICIOUS_TYPE_FOR_LOW_CARDINALITY), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:33: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0cb4d
7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0c98d
8. /build/src/Storages/AlterCommands.cpp:1372: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c250147
9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:28:48.777379 [ 5808 ] {698f2d8c-f0b8-4d05-af61-9abd7675fb21} <Error> executeQuery: Code: 44. DB::Exception: Cannot create column with type 'FixedString(10000)' because fixed string with size > 256 is suspicious. Set setting allow_suspicious_fixed_string_types = 1 in order to allow it. (ILLEGAL_COLUMN) (version 24.3.12.76.altinitystable) (from [::1]:49040) (comment: 03215_validate_type_in_alter_add_modify_column.sql) (in query: alter table test modify column id FixedString(10000);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, int>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<int>::type>, String&&, int&&) @ 0x000000001bc0e62c
6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:58: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0ce1d
7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0c98d
8. /build/src/Storages/AlterCommands.cpp:1372: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c250147
9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:28:48.796070 [ 5808 ] {698f2d8c-f0b8-4d05-af61-9abd7675fb21} <Error> TCPHandler: Code: 44. DB::Exception: Cannot create column with type 'FixedString(10000)' because fixed string with size > 256 is suspicious. Set setting allow_suspicious_fixed_string_types = 1 in order to allow it. (ILLEGAL_COLUMN), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, int>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<int>::type>, String&&, int&&) @ 0x000000001bc0e62c
6. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:58: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&)::$_0::operator()(DB::IDataType const&) const @ 0x000000001bc0ce1d
7. /build/src/Interpreters/parseColumnsListForTableFunction.cpp:109: DB::validateDataType(std::shared_ptr<DB::IDataType const> const&, DB::DataTypeValidationSettings const&) @ 0x000000001bc0c98d
8. /build/src/Storages/AlterCommands.cpp:1372: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c250147
9. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:28:51.203903 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_1_36_7}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:51.704212 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/bzz/zbddonxkldutkilsmwtahhcjneyjt, total size 218103808, count 218103808, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 5f828b8c-389f-4191-abc9-46fa501b00d9, upload has finished false.
2025.03.05 22:28:51.708583 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/bzz/zbddonxkldutkilsmwtahhcjneyjt, total size 218103808, count 218103808, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 5f828b8c-389f-4191-abc9-46fa501b00d9, upload has finished false
2025.03.05 22:28:51.805044 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/bzz/zbddonxkldutkilsmwtahhcjneyjt, total size 218103808, count 218103808, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 5f828b8c-389f-4191-abc9-46fa501b00d9, upload has finished false
2025.03.05 22:28:51.904103 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 46 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:52.896435 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:53.110004 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:54.064966 [ 4786 ] {ffe996ef-1341-48fb-aadf-d513c62efdf0} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:49052) (comment: 00159_parallel_formatting_tsv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format TSV), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:28:54.790601 [ 4786 ] {ffe996ef-1341-48fb-aadf-d513c62efdf0} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:28:54.932210 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_1_36_7}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:55.031431 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 3 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:55.338450 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:55.917106 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:28:59.739927 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:00.202183 [ 4786 ] {86c23b8e-73cf-4f6e-9bfd-c554fcb5b24b} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39492) (comment: 00159_parallel_formatting_tsv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format TSV), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:29:00.531945 [ 4786 ] {86c23b8e-73cf-4f6e-9bfd-c554fcb5b24b} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:29:05.438972 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:06.524087 [ 5819 ] {e634a15e-c890-41b9-91d3-6a4608069122} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39468) (comment: 03215_udf_with_union.sql) (in query: SELECT 03215_udf_with_union();), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:29:06.549563 [ 5819 ] {e634a15e-c890-41b9-91d3-6a4608069122} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:29:10.177416 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/zpa/sjfwltgpvhuwomtzoikompqeqfjsb, total size 218103808, count 218103808, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 8a000d11-6c5a-4674-9ddb-735179d2672d, upload has finished false.
2025.03.05 22:29:10.183360 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/zpa/sjfwltgpvhuwomtzoikompqeqfjsb, total size 218103808, count 218103808, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 8a000d11-6c5a-4674-9ddb-735179d2672d, upload has finished false
2025.03.05 22:29:10.301037 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/zpa/sjfwltgpvhuwomtzoikompqeqfjsb, total size 218103808, count 218103808, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 8a000d11-6c5a-4674-9ddb-735179d2672d, upload has finished false
2025.03.05 22:29:10.402482 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:567: DB::WriteBufferFromS3::writePart(DB::WriteBufferFromS3::PartData&&) @ 0x000000001991336e
18. /build/src/IO/WriteBufferFromS3.cpp:370: DB::WriteBufferFromS3::writeMultipartUpload() @ 0x00000000199074b6
19. /build/src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::nextImpl() @ 0x0000000019906b7e
20. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
21. /build/src/IO/WriteBufferFromFileDecorator.cpp:71: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x000000001a3579ad
22. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
23. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
24. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
25. /build/src/IO/WriteBuffer.h:76: DB::WriteBuffer::nextIfAtEnd() @ 0x000000000a92ff78
26. /build/src/IO/WriteBuffer.h:91: DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000a92fde0
27. /build/src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x0000000019ddbded
28. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
29. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
30. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
31. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:350: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ccf3e39
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:15.752182 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:16.712068 [ 4789 ] {95c8d751-0851-465c-93a4-d12c6221e4d1} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56812) (comment: 03210_variant_with_aggregate_function_type.sql) (in query: INSERT INTO test_agg_variant SELECT Name, t AS Value FROM ( SELECT Name, arrayJoin([ uniqExactState(Value)::Variant(AggregateFunction(uniqExact, Int64), AggregateFunction(avg, Int64)), avgState(Value)::Variant(AggregateFunction(uniqExact, Int64), AggregateFunction(avg, Int64)) ]) AS t FROM source GROUP BY Name );), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d511b1d
13. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d5119aa
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d511939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d51189d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'()::operator()() @ 0x000000001d5117a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5116f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5116d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5116a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:29:16.894149 [ 4789 ] {95c8d751-0851-465c-93a4-d12c6221e4d1} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d511b1d
13. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d5119aa
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d511939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d51189d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'()::operator()() @ 0x000000001d5117a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5116f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5116d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5116a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:29:17.694941 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:18.402346 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column IsBounce): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_6_6_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6868): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:19.296210 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:20.639137 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/yxj/nzizqfmoooeyscjqzahpibpixcxkv, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 90a902bf-9930-4f39-9f48-69e5d2362540, upload has finished false.
2025.03.05 22:29:20.643675 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/yxj/nzizqfmoooeyscjqzahpibpixcxkv, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 90a902bf-9930-4f39-9f48-69e5d2362540, upload has finished false
2025.03.05 22:29:20.686487 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/yxj/nzizqfmoooeyscjqzahpibpixcxkv, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 90a902bf-9930-4f39-9f48-69e5d2362540, upload has finished false
2025.03.05 22:29:20.821839 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 21 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:22.659807 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column StartDate): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_1_1_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6658): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:23.759455 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:25.994728 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_1_42_8}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:26.337307 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:27.892241 [ 3612 ] {} <Error> void DB::SystemLog<DB::QueryViewsLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryViewsLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:31.652708 [ 4789 ] {7130be39-4eb2-43bc-a37d-d0d1b3130873} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59404) (comment: 03209_parameterized_view_with_non_literal_params.sql) (in query: select id from date_pv(dtparam=yesterday());), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:29:31.686529 [ 4789 ] {7130be39-4eb2-43bc-a37d-d0d1b3130873} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:29:32.036649 [ 4786 ] {20b37568-0694-422d-908e-bb47340d466b} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=44, jobs=44). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59422) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:29:32.072962 [ 4786 ] {20b37568-0694-422d-908e-bb47340d466b} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=44, jobs=44). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:29:32.275893 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/ntm/hywiabifdqxaabyunbeepbijroaxd, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 6439a3bf-0e30-46ca-b318-6c2d55354c36, upload has finished false.
2025.03.05 22:29:32.282535 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/ntm/hywiabifdqxaabyunbeepbijroaxd, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 6439a3bf-0e30-46ca-b318-6c2d55354c36, upload has finished false
2025.03.05 22:29:32.353274 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/ntm/hywiabifdqxaabyunbeepbijroaxd, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 6439a3bf-0e30-46ca-b318-6c2d55354c36, upload has finished false
2025.03.05 22:29:32.401001 [ 3587 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Removing temporary directory /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:29:32.401668 [ 3587 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:29:32.492863 [ 3541 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 28 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:36.272258 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 3 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:37.059402 [ 5819 ] {9921e259-3fcd-410f-9cab-feb67e5f8bdc} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=40, jobs=40). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39644) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:29:37.133257 [ 5819 ] {9921e259-3fcd-410f-9cab-feb67e5f8bdc} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=40, jobs=40). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:29:41.857358 [ 5819 ] {e773f0a4-f007-4555-9344-efebda50ea24} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39662) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:29:41.872622 [ 4786 ] {67d53b1e-27d9-450e-9f92-e6547d97e1db} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39660) (comment: 03205_parallel_window_finctions_and_column_sparse_bug.sql) (in query: CREATE TABLE t (`c` Int32, `d` Bool) ENGINE = MergeTree ORDER BY c SETTINGS index_granularity = 9365, min_bytes_for_wide_part = 0, ratio_of_defaults_for_sparse_serialization = 0.393785297870636, replace_long_file_name_to_hash = false, max_file_name_length = 128, min_bytes_for_full_part_storage = 72360528, compact_parts_max_bytes_to_buffer = 211837171, compact_parts_max_granules_to_buffer = 77, compact_parts_merge_max_bytes_to_prefetch_part = 8401062, merge_max_block_size = 2054, old_parts_lifetime = 30., prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 10737418240, index_granularity_bytes = 6806805, concurrent_part_removal_threshold = 100, allow_vertical_merges_from_compact_to_wide_parts = true, cache_populated_by_fetch = true, marks_compress_block_size = 91784, primary_key_compress_block_size = 49899), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a357647
21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3573b9
22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a927662
23. /build/src/Storages/MergeTree/MergeTreeData.cpp:306: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000001cbacb42
24. /build/src/Storages/StorageMergeTree.cpp:117: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>) @ 0x000000001d0e9fd1
25. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageMergeTree* std::construct_at[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::StorageMergeTree*>(DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e99b7
26. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageMergeTree>>::construct[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void, void>(std::allocator<DB::StorageMergeTree>&, DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e96c7
27. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>>(std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e9375
28. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e91a7
29. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageMergeTree> std::make_shared[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e636d
30. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:741: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e3eaa
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019306cfd

2025.03.05 22:29:41.876591 [ 5819 ] {e773f0a4-f007-4555-9344-efebda50ea24} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:29:41.915780 [ 4786 ] {67d53b1e-27d9-450e-9f92-e6547d97e1db} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a357647
21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3573b9
22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a927662
23. /build/src/Storages/MergeTree/MergeTreeData.cpp:306: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000001cbacb42
24. /build/src/Storages/StorageMergeTree.cpp:117: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>) @ 0x000000001d0e9fd1
25. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageMergeTree* std::construct_at[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::StorageMergeTree*>(DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e99b7
26. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageMergeTree>>::construct[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void, void>(std::allocator<DB::StorageMergeTree>&, DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e96c7
27. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>>(std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e9375
28. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e91a7
29. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageMergeTree> std::make_shared[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e636d
30. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:741: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e3eaa
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019306cfd

2025.03.05 22:29:45.663078 [ 3542 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/gto/jcxrcvjnotiuqoqigkvxbhwklwshq, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2b9ea2e6-3bfe-412f-a849-57f9cdf34193, upload has finished false.
2025.03.05 22:29:45.665613 [ 3542 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/gto/jcxrcvjnotiuqoqigkvxbhwklwshq, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2b9ea2e6-3bfe-412f-a849-57f9cdf34193, upload has finished false
2025.03.05 22:29:45.722572 [ 3542 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/gto/jcxrcvjnotiuqoqigkvxbhwklwshq, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2b9ea2e6-3bfe-412f-a849-57f9cdf34193, upload has finished false
2025.03.05 22:29:45.876101 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 22 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:46.683713 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38ea0
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:46.752420 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:46.908139 [ 5819 ] {e62fbb6d-a8a9-49d3-ae40-60cab067fbe3} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46680) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:29:46.953386 [ 5819 ] {e62fbb6d-a8a9-49d3-ae40-60cab067fbe3} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:29:51.364889 [ 3550 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 10 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:52.416459 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:29:53.241151 [ 5808 ] {78b541c7-9edb-4734-8407-71a08dd21017} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46712) (comment: 03203_system_numbers_limit_and_offset_complex.sql) (in query: --- The following query was buggy before, so let's use it as a test case
 WITH (num > 1) AND (arraySum(arrayMap(y -> ((y > 1) AND (y < num) AND ((num % y) = 0)), range(toUInt64(sqrt(num)) + 1))) = 0) AS is_prime_slow SELECT num, ds, FROM ( WITH arraySum(arrayMap(y -> toUInt8(y), splitByString('', toString(num)))) AS digits_sum SELECT 1 + (number * 2) AS num, digits_sum AS ds FROM numbers_mt(10000) WHERE ds IN ( WITH (number > 1) AND (arraySum(arrayMap(y -> ((y > 1) AND (y < number) AND ((number % y) = 0)), range(toUInt64(sqrt(number)) + 1))) = 0) AS is_prime_slow SELECT number FROM numbers(180 + 1) WHERE is_prime_slow ) ) WHERE is_prime_slow ORDER BY num ASC LIMIT 998, 1 SETTINGS max_block_size = 64, max_threads=16;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:29:53.371454 [ 5808 ] {78b541c7-9edb-4734-8407-71a08dd21017} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:29:56.140635 [ 5819 ] {831d0227-5ed9-4927-8066-459ee8ec1437} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39244) (comment: 00159_parallel_formatting_json_and_friends_1.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactStringsEachRow), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:29:56.318225 [ 5819 ] {831d0227-5ed9-4927-8066-459ee8ec1437} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:29:59.678185 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/smq/lpjmvwvpxnviwdpbmxfcmlyhucmoj, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id a24084f0-80b0-4d0f-90d7-6ff2643d15c3, upload has finished false.
2025.03.05 22:29:59.692067 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/smq/lpjmvwvpxnviwdpbmxfcmlyhucmoj, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id a24084f0-80b0-4d0f-90d7-6ff2643d15c3, upload has finished false
2025.03.05 22:29:59.752965 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/smq/lpjmvwvpxnviwdpbmxfcmlyhucmoj, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id a24084f0-80b0-4d0f-90d7-6ff2643d15c3, upload has finished false
2025.03.05 22:29:59.864042 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 16 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:30:01.400838 [ 5808 ] {b47dbd56-af6f-4198-a28b-29d045b28d47} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39292) (comment: 00159_parallel_formatting_json_and_friends_1.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:01.838964 [ 5808 ] {b47dbd56-af6f-4198-a28b-29d045b28d47} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:04.236602 [ 5808 ] {1aacc2de-36dc-4881-a77b-ce7b8576117d} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39316) (comment: 00159_parallel_formatting_tsv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format TSVWithNames), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:04.519424 [ 5808 ] {1aacc2de-36dc-4881-a77b-ce7b8576117d} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:06.568043 [ 5808 ] {e3b557bb-c025-45fb-8117-cb154788de55} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:58914) (comment: 00159_parallel_formatting_json_and_friends_1.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format JSONCompactEachRowWithNames), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:30:06.626429 [ 5808 ] {e3b557bb-c025-45fb-8117-cb154788de55} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:30:07.012929 [ 4786 ] {250c50be-f02d-4bf3-a1d8-9f04aff1faa0} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:58916) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:07.074762 [ 4786 ] {250c50be-f02d-4bf3-a1d8-9f04aff1faa0} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:12.311169 [ 4786 ] {6e60af35-b9ec-4e5c-9432-b5def0966200} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:58962) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:12.355181 [ 4786 ] {6e60af35-b9ec-4e5c-9432-b5def0966200} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:13.769237 [ 5808 ] {48f39c87-7d93-4b14-bc39-fc4adb280a8c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:58930) (comment: 00159_parallel_formatting_tsv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c LIMIT 3000000 Format TSKV), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:30:14.336634 [ 5808 ] {48f39c87-7d93-4b14-bc39-fc4adb280a8c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:30:17.261757 [ 4789 ] {e7b16bd6-5d90-4b2e-9cf0-5e37c53b6805} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:52402) (comment: 03203_count_with_non_deterministic_function.sql) (in query: SELECT count() FROM t WHERE p = 0 AND rowNumberInAllBlocks() = 1 SETTINGS allow_experimental_analyzer = 0;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:17.419253 [ 5808 ] {f7976723-e6cc-4bb3-8d92-4071f7f340ec} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:52414) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:30:17.462447 [ 5808 ] {f7976723-e6cc-4bb3-8d92-4071f7f340ec} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:30:17.459718 [ 4789 ] {e7b16bd6-5d90-4b2e-9cf0-5e37c53b6805} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:19.044204 [ 5724 ] {552efb0c-dfb3-438f-ad28-c9e98beda1b5} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=16, jobs=14). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:58946) (comment: 00053_replicate_segfault.sql) (in query: SELECT count() > 0 FROM (SELECT ParsedParams.Key1 AS p FROM test.visits WHERE arrayAll(y -> arrayExists(x -> y != x, p), p)) ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:21.381569 [ 5724 ] {552efb0c-dfb3-438f-ad28-c9e98beda1b5} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=16, jobs=14). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:22.911885 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/abs/cmkwzfzsoeyflnviockejfpjpxfjt, total size 318767104, count 318767104, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id c1934b28-4465-465e-9d13-5b2ed0daf260, upload has finished false.
2025.03.05 22:30:22.917249 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/abs/cmkwzfzsoeyflnviockejfpjpxfjt, total size 318767104, count 318767104, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id c1934b28-4465-465e-9d13-5b2ed0daf260, upload has finished false
2025.03.05 22:30:23.073910 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/abs/cmkwzfzsoeyflnviockejfpjpxfjt, total size 318767104, count 318767104, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id c1934b28-4465-465e-9d13-5b2ed0daf260, upload has finished false
2025.03.05 22:30:23.190281 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 69 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:30:29.265228 [ 2811 ] {5b53aa2c-e74b-470a-a855-239e55e1624f} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53052) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:30:29.297073 [ 2811 ] {5b53aa2c-e74b-470a-a855-239e55e1624f} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:30:34.953772 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/tnx/rrbtrfpzeuwyxlrvsffzrxfaobzlg, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 0c8bff02-748f-4f20-ae63-213c4f87d35f, upload has finished false.
2025.03.05 22:30:34.960078 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/tnx/rrbtrfpzeuwyxlrvsffzrxfaobzlg, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 0c8bff02-748f-4f20-ae63-213c4f87d35f, upload has finished false
2025.03.05 22:30:35.011060 [ 5808 ] {f44def1d-08f1-4a94-a1b3-1d07f53833f8} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:49126) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:35.026277 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/tnx/rrbtrfpzeuwyxlrvsffzrxfaobzlg, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 0c8bff02-748f-4f20-ae63-213c4f87d35f, upload has finished false
2025.03.05 22:30:35.045347 [ 5808 ] {f44def1d-08f1-4a94-a1b3-1d07f53833f8} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:35.202442 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 23 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:30:37.825981 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:30:38.603963 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_1_52_10}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:30:40.163419 [ 2811 ] {aba76342-c7a4-4d91-8847-384c94ab77f1} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=22, jobs=22). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:49150) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:40.249739 [ 2811 ] {aba76342-c7a4-4d91-8847-384c94ab77f1} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=22, jobs=22). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:41.288239 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:30:45.519493 [ 2811 ] {d30e3fde-05ec-4852-8ed1-0a3010175d43} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=33, jobs=19). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39134) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:45.553948 [ 2811 ] {d30e3fde-05ec-4852-8ed1-0a3010175d43} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=33, jobs=19). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:47.336155 [ 2811 ] {dfa867ca-f838-476a-ad03-1130fc7f5489} <Error> executeQuery: Code: 475. DB::Exception: Incompatible types of WITH FILL expression values with column type Date. (INVALID_WITH_FILL_EXPRESSION) (version 24.3.12.76.altinitystable) (from [::1]:39142) (comment: 02561_with_fill_date_datetime_incompatible.sql) (in query: SELECT today() AS a ORDER BY a ASC WITH FILL FROM now() - toIntervalMonth(1) TO now() + toIntervalDay(1) STEP 82600;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Processors/Transforms/FillingTransform.cpp:227: DB::FillingTransform::FillingTransform(DB::Block const&, DB::SortDescription const&, DB::SortDescription const&, std::shared_ptr<DB::InterpolateDescription>, bool) @ 0x000000001dce84db
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::FillingTransform* std::construct_at[abi:v15000]<DB::FillingTransform, DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>, bool const&, DB::FillingTransform*>(DB::FillingTransform*, DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>&&, bool const&) @ 0x000000001dce77d8
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::FillingTransform>>::construct[abi:v15000]<DB::FillingTransform, DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>, bool const&, void, void>(std::allocator<DB::FillingTransform>&, DB::FillingTransform*, DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>&&, bool const&) @ 0x000000001dce7541
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::FillingTransform, std::allocator<DB::FillingTransform>>::__shared_ptr_emplace[abi:v15000]<DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>, bool const&>(std::allocator<DB::FillingTransform>, DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>&&, bool const&) @ 0x000000001dce722d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::FillingTransform> std::allocate_shared[abi:v15000]<DB::FillingTransform, std::allocator<DB::FillingTransform>, DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>, bool const&, void>(std::allocator<DB::FillingTransform> const&, DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>&&, bool const&) @ 0x000000001dce707a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::FillingTransform> std::make_shared[abi:v15000]<DB::FillingTransform, DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>, bool const&, void>(DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>&&, bool const&) @ 0x000000001dce6466
12. /build/src/Processors/QueryPlan/FillingStep.cpp:53: DB::FillingStep::transformPipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&)::$_0::operator()(DB::Block const&, DB::Pipe::StreamType) const @ 0x000000001dce61d1
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001dce6127
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001dce60e5
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001dce60a5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001dce604c
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019e50728
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019e506a4
19. /build/src/QueryPipeline/Pipe.cpp:593: DB::Pipe::addSimpleTransform(std::function<std::shared_ptr<DB::IProcessor> (DB::Block const&, DB::Pipe::StreamType)> const&)::$_0::operator()(DB::OutputPort*&, DB::Pipe::StreamType) const @ 0x0000000019e3ec2e
20. /build/src/QueryPipeline/Pipe.cpp:633: DB::Pipe::addSimpleTransform(std::function<std::shared_ptr<DB::IProcessor> (DB::Block const&, DB::Pipe::StreamType)> const&) @ 0x0000000019e3eb15
21. /build/src/QueryPipeline/QueryPipelineBuilder.cpp:136: DB::QueryPipelineBuilder::addSimpleTransform(std::function<std::shared_ptr<DB::IProcessor> (DB::Block const&, DB::Pipe::StreamType)> const&) @ 0x0000000019e7304e
22. /build/src/Processors/QueryPlan/FillingStep.cpp:48: DB::FillingStep::transformPipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dce5ae2
23. /build/src/Processors/QueryPlan/ITransformingStep.cpp:41: DB::ITransformingStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07fa6
24. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
25. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
27. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
28. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
29. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
30. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
31. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9

2025.03.05 22:30:47.360904 [ 2811 ] {dfa867ca-f838-476a-ad03-1130fc7f5489} <Error> TCPHandler: Code: 475. DB::Exception: Incompatible types of WITH FILL expression values with column type Date. (INVALID_WITH_FILL_EXPRESSION), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Processors/Transforms/FillingTransform.cpp:227: DB::FillingTransform::FillingTransform(DB::Block const&, DB::SortDescription const&, DB::SortDescription const&, std::shared_ptr<DB::InterpolateDescription>, bool) @ 0x000000001dce84db
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::FillingTransform* std::construct_at[abi:v15000]<DB::FillingTransform, DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>, bool const&, DB::FillingTransform*>(DB::FillingTransform*, DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>&&, bool const&) @ 0x000000001dce77d8
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::FillingTransform>>::construct[abi:v15000]<DB::FillingTransform, DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>, bool const&, void, void>(std::allocator<DB::FillingTransform>&, DB::FillingTransform*, DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>&&, bool const&) @ 0x000000001dce7541
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::FillingTransform, std::allocator<DB::FillingTransform>>::__shared_ptr_emplace[abi:v15000]<DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>, bool const&>(std::allocator<DB::FillingTransform>, DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>&&, bool const&) @ 0x000000001dce722d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::FillingTransform> std::allocate_shared[abi:v15000]<DB::FillingTransform, std::allocator<DB::FillingTransform>, DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>, bool const&, void>(std::allocator<DB::FillingTransform> const&, DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>&&, bool const&) @ 0x000000001dce707a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::FillingTransform> std::make_shared[abi:v15000]<DB::FillingTransform, DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>, bool const&, void>(DB::Block const&, DB::SortDescription&, DB::SortDescription&, std::shared_ptr<DB::InterpolateDescription>&&, bool const&) @ 0x000000001dce6466
12. /build/src/Processors/QueryPlan/FillingStep.cpp:53: DB::FillingStep::transformPipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&)::$_0::operator()(DB::Block const&, DB::Pipe::StreamType) const @ 0x000000001dce61d1
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001dce6127
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001dce60e5
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001dce60a5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001dce604c
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019e50728
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019e506a4
19. /build/src/QueryPipeline/Pipe.cpp:593: DB::Pipe::addSimpleTransform(std::function<std::shared_ptr<DB::IProcessor> (DB::Block const&, DB::Pipe::StreamType)> const&)::$_0::operator()(DB::OutputPort*&, DB::Pipe::StreamType) const @ 0x0000000019e3ec2e
20. /build/src/QueryPipeline/Pipe.cpp:633: DB::Pipe::addSimpleTransform(std::function<std::shared_ptr<DB::IProcessor> (DB::Block const&, DB::Pipe::StreamType)> const&) @ 0x0000000019e3eb15
21. /build/src/QueryPipeline/QueryPipelineBuilder.cpp:136: DB::QueryPipelineBuilder::addSimpleTransform(std::function<std::shared_ptr<DB::IProcessor> (DB::Block const&, DB::Pipe::StreamType)> const&) @ 0x0000000019e7304e
22. /build/src/Processors/QueryPlan/FillingStep.cpp:48: DB::FillingStep::transformPipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dce5ae2
23. /build/src/Processors/QueryPlan/ITransformingStep.cpp:41: DB::ITransformingStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07fa6
24. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
25. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
27. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
28. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
29. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
30. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
31. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9

2025.03.05 22:30:50.207949 [ 5809 ] {9174a8bb-2407-4cf5-9e41-9982cc093296} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=10). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53046) (comment: 00172_hits_joins.gen.sql) (in query: SELECT EventDate, hits, visits FROM ( SELECT EventDate, count() AS hits FROM test.hits GROUP BY EventDate ) ANY LEFT JOIN ( SELECT StartDate AS EventDate, sum(Sign) AS visits FROM test.visits GROUP BY EventDate ) USING EventDate ORDER BY hits DESC LIMIT 10 SETTINGS joined_subquery_requires_alias = 0;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:50.652537 [ 2811 ] {d7d369cc-334d-41d6-b045-ab01d59afcb7} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39176) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:30:50.696834 [ 2811 ] {d7d369cc-334d-41d6-b045-ab01d59afcb7} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:30:51.497251 [ 3544 ] {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key s3/xqe/cowfiewbuvxiolnfglsceehbhuurf, total size 122843301, count 122843301, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 49f01e7b-0506-45fe-8949-a81be8c80db0, upload has finished false.
2025.03.05 22:30:51.527427 [ 3544 ] {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key s3/xqe/cowfiewbuvxiolnfglsceehbhuurf, total size 122843301, count 122843301, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 49f01e7b-0506-45fe-8949-a81be8c80db0, upload has finished false
2025.03.05 22:30:51.600448 [ 3544 ] {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key s3/xqe/cowfiewbuvxiolnfglsceehbhuurf, total size 122843301, count 122843301, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id 49f01e7b-0506-45fe-8949-a81be8c80db0, upload has finished false
2025.03.05 22:30:52.247288 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column StartURL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_5_5_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 1 with max_rows_to_read = 6739): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:30:53.095144 [ 5809 ] {9174a8bb-2407-4cf5-9e41-9982cc093296} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=10). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:54.698192 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/ten/lfckwwiemealerytlkgvlpwejnngg, total size 218103808, count 218103808, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 5a25ead2-c4b1-4ea1-bb0e-2117d2a6a48f, upload has finished false.
2025.03.05 22:30:54.698984 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/ten/lfckwwiemealerytlkgvlpwejnngg, total size 218103808, count 218103808, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 5a25ead2-c4b1-4ea1-bb0e-2117d2a6a48f, upload has finished false
2025.03.05 22:30:54.786043 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/ten/lfckwwiemealerytlkgvlpwejnngg, total size 218103808, count 218103808, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 5a25ead2-c4b1-4ea1-bb0e-2117d2a6a48f, upload has finished false
2025.03.05 22:30:54.846456 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 46 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:30:55.912824 [ 5809 ] {8474d1bb-bdff-4b81-9918-99ea396aa86a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54946) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:30:55.950100 [ 5809 ] {8474d1bb-bdff-4b81-9918-99ea396aa86a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:00.154752 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:00.903002 [ 4786 ] {d645c78e-6207-4657-b2e7-d54bb3b6a4f2} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54974) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:00.972254 [ 4786 ] {d645c78e-6207-4657-b2e7-d54bb3b6a4f2} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:01.628954 [ 3780 ] {dd19f34d-953b-4056-8944-2c2d033d627e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54988) (in query: select x, y, y.UInt64, y.String, v, v.String, v.UInt64, v.Date from test order by x), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:01.698175 [ 3780 ] {dd19f34d-953b-4056-8944-2c2d033d627e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:02.154443 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/hph/khdoppbeovudjjovkcbdcjdhmetmq, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 7c09f6f4-b6c4-46ab-94a3-36154142a2b0, upload has finished false.
2025.03.05 22:31:02.164008 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/hph/khdoppbeovudjjovkcbdcjdhmetmq, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 7c09f6f4-b6c4-46ab-94a3-36154142a2b0, upload has finished false
2025.03.05 22:31:02.218032 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/hph/khdoppbeovudjjovkcbdcjdhmetmq, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 7c09f6f4-b6c4-46ab-94a3-36154142a2b0, upload has finished false
2025.03.05 22:31:02.351526 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 17 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:03.216678 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {0d6617f8-564f-43ff-a6dc-a74b9f150261::202503_1_36_7}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:03.860098 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:04.965222 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7a26c9c9-7195-4e8c-807c-8ccd93ff5af2::202503_1_35_6}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:05.273939 [ 4786 ] {5b8b1aa1-d346-423b-800b-456fa185c678} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=936, jobs=840). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60864) (comment: 03199_unbin_buffer_overflow.sh) (in query: SELECT count() FROM numbers(99) GROUP BY unbin(toFixedString(materialize('xxxxxxxx'), 8)) WITH ROLLUP WITH TOTALS FORMAT NULL), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:31:05.337624 [ 4786 ] {5b8b1aa1-d346-423b-800b-456fa185c678} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=936, jobs=840). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:31:11.375095 [ 3923 ] {63c6cef6-b29e-4211-b32b-4016ccfdbfd8} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=38, jobs=38). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60900) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:11.410621 [ 3923 ] {63c6cef6-b29e-4211-b32b-4016ccfdbfd8} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=38, jobs=38). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:11.503211 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:15.437840 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/stb/pomoviffxziejfjfjbggytxgjoxvc, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e27aaf1b-5119-4399-9d78-b396c3c4a974, upload has finished false.
2025.03.05 22:31:15.439764 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/stb/pomoviffxziejfjfjbggytxgjoxvc, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e27aaf1b-5119-4399-9d78-b396c3c4a974, upload has finished false
2025.03.05 22:31:15.506096 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/stb/pomoviffxziejfjfjbggytxgjoxvc, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e27aaf1b-5119-4399-9d78-b396c3c4a974, upload has finished false
2025.03.05 22:31:15.580362 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 31 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:16.141495 [ 3780 ] {871b6798-7b85-4f02-a254-5ebd6135ca2c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=21, jobs=21). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39448) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:16.183768 [ 3780 ] {871b6798-7b85-4f02-a254-5ebd6135ca2c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=21, jobs=21). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:19.553664 [ 3780 ] {988babd5-c3a7-4f01-adaa-d8287b969c77} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39476) (in query: CREATE TABLE test (`x` UInt64, `y` UInt64) ENGINE = MergeTree ORDER BY x SETTINGS min_rows_for_wide_part = 100000000, min_bytes_for_wide_part = 1000000000, index_granularity = 46833, ratio_of_defaults_for_sparse_serialization = 0.2138921171426773, replace_long_file_name_to_hash = true, max_file_name_length = 2, min_bytes_for_full_part_storage = 0, compact_parts_max_bytes_to_buffer = 289695559, compact_parts_max_granules_to_buffer = 3, compact_parts_merge_max_bytes_to_prefetch_part = 7250734, merge_max_block_size = 1173, old_parts_lifetime = 480., prefer_fetch_merged_part_size_threshold = 10737418240, vertical_merge_algorithm_min_rows_to_activate = 1, vertical_merge_algorithm_min_columns_to_activate = 1, min_merge_bytes_to_use_direct_io = 1, index_granularity_bytes = 21268780, concurrent_part_removal_threshold = 100, allow_vertical_merges_from_compact_to_wide_parts = true, cache_populated_by_fetch = true, marks_compress_block_size = 23467, primary_key_compress_block_size = 24914), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a357647
21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3573b9
22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a927662
23. /build/src/Storages/MergeTree/MergeTreeData.cpp:306: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000001cbacb42
24. /build/src/Storages/StorageMergeTree.cpp:117: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>) @ 0x000000001d0e9fd1
25. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageMergeTree* std::construct_at[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::StorageMergeTree*>(DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e99b7
26. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageMergeTree>>::construct[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void, void>(std::allocator<DB::StorageMergeTree>&, DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e96c7
27. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>>(std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e9375
28. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e91a7
29. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageMergeTree> std::make_shared[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e636d
30. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:741: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e3eaa
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019306cfd

2025.03.05 22:31:19.588200 [ 3780 ] {988babd5-c3a7-4f01-adaa-d8287b969c77} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a357647
21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3573b9
22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a927662
23. /build/src/Storages/MergeTree/MergeTreeData.cpp:306: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000001cbacb42
24. /build/src/Storages/StorageMergeTree.cpp:117: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>) @ 0x000000001d0e9fd1
25. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageMergeTree* std::construct_at[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::StorageMergeTree*>(DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e99b7
26. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageMergeTree>>::construct[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void, void>(std::allocator<DB::StorageMergeTree>&, DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e96c7
27. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>>(std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e9375
28. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e91a7
29. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageMergeTree> std::make_shared[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e636d
30. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:741: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e3eaa
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019306cfd

2025.03.05 22:31:21.266117 [ 3780 ] {bfcc98a8-853b-4a30-bbdc-117933f82bea} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39490) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:31:21.302633 [ 3780 ] {bfcc98a8-853b-4a30-bbdc-117933f82bea} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:31:21.504226 [ 5724 ] {2cec8ae0-8765-455f-a15c-0b356c8b4123} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=14, jobs=14). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39460) (comment: 00049_max_string_if.sql) (in query: SELECT CounterID, count(), maxIf(SearchPhrase, notEmpty(SearchPhrase)) FROM test.hits GROUP BY CounterID ORDER BY count() DESC LIMIT 20;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:22.855467 [ 5724 ] {2cec8ae0-8765-455f-a15c-0b356c8b4123} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=14, jobs=14). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:24.393443 [ 3923 ] {bd458303-cf23-4693-ac78-1ced87d14e61} <Error> executeQuery: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:43860) (in query: insert into test select number, number from numbers(3)), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterInsertQuery.cpp:123: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b428512
10. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42a984
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:31:24.451505 [ 3923 ] {bd458303-cf23-4693-ac78-1ced87d14e61} <Error> TCPHandler: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterInsertQuery.cpp:123: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b428512
10. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42a984
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:31:24.936340 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:25.966757 [ 3780 ] {79d7d785-db2e-4f83-9f5a-b94275f292f0} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=15, jobs=15). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43874) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:26.114391 [ 3780 ] {79d7d785-db2e-4f83-9f5a-b94275f292f0} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=15, jobs=15). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:26.737452 [ 3923 ] {be95d5b8-552a-453b-95d9-5d4b6317a5c6} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43868) (comment: 00080_array_join_and_union.sql) (in query: SELECT count() FROM (SELECT Goals.ID FROM test.visits ARRAY JOIN Goals WHERE CounterID = 842440 LIMIT 10 UNION ALL SELECT Goals.ID FROM test.visits ARRAY JOIN Goals WHERE CounterID = 842440 LIMIT 10);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:31:26.799879 [ 3923 ] {be95d5b8-552a-453b-95d9-5d4b6317a5c6} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:31:28.692755 [ 3923 ] {8018b79c-961e-4eed-9c3f-65f8f45bef64} <Error> executeQuery: Code: 60. DB::Exception: Could not find table: test. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:43904) (in query: alter table test add column v Variant(UInt64, String) settings mutations_sync=1), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x000000000a941553
6. /build/src/Interpreters/InterpreterAlterQuery.cpp:124: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff7ee8
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
9. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
10. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:31:28.736522 [ 3923 ] {8018b79c-961e-4eed-9c3f-65f8f45bef64} <Error> TCPHandler: Code: 60. DB::Exception: Could not find table: test. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x000000000a941553
6. /build/src/Interpreters/InterpreterAlterQuery.cpp:124: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff7ee8
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
9. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
10. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:31:29.032788 [ 3780 ] {0eda5104-2713-4105-b2d5-e685b17f035a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=27, jobs=27). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43884) (comment: 00078_group_by_arrays.sql) (in query: SELECT GoalsReached AS k, count() AS c FROM test.hits GROUP BY k ORDER BY c DESC LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:30.830249 [ 3923 ] {f49139b6-aab0-4f22-b0f5-c7e121f7a766} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43906) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:30.920696 [ 3923 ] {f49139b6-aab0-4f22-b0f5-c7e121f7a766} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:30.957319 [ 3780 ] {0eda5104-2713-4105-b2d5-e685b17f035a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=27, jobs=27). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:33.098033 [ 3923 ] {a58f4656-b062-4f27-b55c-7baa44ec8222} <Error> executeQuery: Code: 60. DB::Exception: Unknown table expression identifier 'test' in scope SELECT x, y, v, v.String, v.UInt64 FROM test ORDER BY x ASC. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:43930) (in query: select x, y, v, v.String, v.UInt64 from test order by x), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a8b52
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09baa3
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:31:33.099875 [ 3633 ] {} <Error> void DB::SystemLog<DB::TraceLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:33.137651 [ 3923 ] {a58f4656-b062-4f27-b55c-7baa44ec8222} <Error> TCPHandler: Code: 60. DB::Exception: Unknown table expression identifier 'test' in scope SELECT x, y, v, v.String, v.UInt64 FROM test ORDER BY x ASC. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a8b52
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09baa3
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:31:33.810174 [ 5809 ] {e0f110b4-fd7f-4034-9b4c-1577d3064827} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43908) (comment: 00084_external_aggregation.sql) (in query: SELECT URL, uniq(SearchPhrase) AS u FROM test.hits GROUP BY URL ORDER BY u DESC, URL LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/SerializationSparse.cpp:165: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x000000001a051489

2025.03.05 22:31:34.286566 [ 5809 ] {e0f110b4-fd7f-4034-9b4c-1577d3064827} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/SerializationSparse.cpp:165: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x000000001a051489

2025.03.05 22:31:34.291086 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/tyu/iejfxrlkbwwjsyzduxfzqenadbhmb, total size 251658240, count 251658240, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 36f178c0-7d12-4d1f-8950-7a51a738ce4b, upload has finished false.
2025.03.05 22:31:34.295043 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/tyu/iejfxrlkbwwjsyzduxfzqenadbhmb, total size 251658240, count 251658240, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 36f178c0-7d12-4d1f-8950-7a51a738ce4b, upload has finished false
2025.03.05 22:31:34.399358 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/tyu/iejfxrlkbwwjsyzduxfzqenadbhmb, total size 251658240, count 251658240, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 36f178c0-7d12-4d1f-8950-7a51a738ce4b, upload has finished false
2025.03.05 22:31:34.437689 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 55 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:34.446832 [ 3604 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:37.268218 [ 3923 ] {71c39406-8769-4531-92af-c18ba49cb665} <Error> executeQuery: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:42050) (in query: insert into test select number, number, number from numbers(3, 3)), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterInsertQuery.cpp:123: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b428512
10. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42a984
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:31:37.285276 [ 3923 ] {71c39406-8769-4531-92af-c18ba49cb665} <Error> TCPHandler: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterInsertQuery.cpp:123: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b428512
10. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42a984
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:31:39.851224 [ 3541 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {09669507-4528-4e20-b87c-26ebd7ba8c50::202503_1_45_9}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:40.289751 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:40.721100 [ 3923 ] {cdf7d221-2d93-49ae-bef3-8b17011bd493} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42076) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:31:40.851618 [ 3923 ] {cdf7d221-2d93-49ae-bef3-8b17011bd493} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:31:41.639243 [ 5819 ] {088b0cb9-0c3e-408e-8e2b-739b16137eb1} <Error> executeQuery: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:42102) (in query: insert into test select number, number, 'str_' || toString(number) from numbers(6, 3)), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterInsertQuery.cpp:123: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b428512
10. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42a984
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:31:41.657067 [ 5819 ] {088b0cb9-0c3e-408e-8e2b-739b16137eb1} <Error> TCPHandler: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterInsertQuery.cpp:123: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b428512
10. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42a984
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:31:45.933502 [ 5819 ] {3aded99f-b01b-4fcb-a303-92da70595489} <Error> executeQuery: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:41576) (in query: insert into test select number, number, NULL from numbers(9, 3)), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterInsertQuery.cpp:123: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b428512
10. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42a984
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:31:45.945566 [ 5819 ] {3aded99f-b01b-4fcb-a303-92da70595489} <Error> TCPHandler: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterInsertQuery.cpp:123: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b428512
10. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42a984
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:31:45.983634 [ 5724 ] {8b8f7c26-1360-495a-97dd-629a41a6661b} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41574) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:46.063200 [ 5724 ] {8b8f7c26-1360-495a-97dd-629a41a6661b} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:31:47.103128 [ 5809 ] {7a2886fe-4162-40fa-8400-15d3f38c821f} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=44): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42100) (comment: 00180_no_seek_avoiding_when_reading_from_cache.sh) (in query: INSERT INTO hits_s3_sampled SELECT * FROM test.hits_s3 SAMPLE 0.01), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:31:47.446789 [ 5809 ] {7a2886fe-4162-40fa-8400-15d3f38c821f} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=44): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:31:48.697913 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:49.425540 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/vpq/ktprnenhhcwnpwaarsvpoppfmfwfe, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4cb1ee06-b59d-4c92-927d-db44a3f95874, upload has finished false.
2025.03.05 22:31:49.426435 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/vpq/ktprnenhhcwnpwaarsvpoppfmfwfe, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4cb1ee06-b59d-4c92-927d-db44a3f95874, upload has finished false
2025.03.05 22:31:49.485008 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/vpq/ktprnenhhcwnpwaarsvpoppfmfwfe, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4cb1ee06-b59d-4c92-927d-db44a3f95874, upload has finished false
2025.03.05 22:31:49.542999 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 25 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:50.541239 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:50.555684 [ 5819 ] {9f11978e-fe1f-4a95-971f-11b3b2362980} <Error> executeQuery: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:41612) (in query: insert into test select number, number, multiIf(number % 3 == 0, number, number % 3 == 1, 'str_' || toString(number), NULL) from numbers(12, 3)), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterInsertQuery.cpp:123: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b428512
10. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42a984
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:31:50.575968 [ 5819 ] {9f11978e-fe1f-4a95-971f-11b3b2362980} <Error> TCPHandler: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterInsertQuery.cpp:123: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b428512
10. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42a984
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:31:51.053911 [ 5724 ] {fc54cdbe-bd27-42ca-92ee-d5204fb62fdc} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41618) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:31:51.138500 [ 5724 ] {fc54cdbe-bd27-42ca-92ee-d5204fb62fdc} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:31:51.873720 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column PageViews): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_6_6_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6868): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:54.842983 [ 5819 ] {f8852e55-e382-41fd-bc69-274f6d0100b4} <Error> executeQuery: Code: 60. DB::Exception: Unknown table expression identifier 'test' in scope SELECT x, y, v, v.String, v.UInt64 FROM test ORDER BY x ASC. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:55956) (in query: select x, y, v, v.String, v.UInt64 from test order by x), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a8b52
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09baa3
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:31:54.862160 [ 5819 ] {f8852e55-e382-41fd-bc69-274f6d0100b4} <Error> TCPHandler: Code: 60. DB::Exception: Unknown table expression identifier 'test' in scope SELECT x, y, v, v.String, v.UInt64 FROM test ORDER BY x ASC. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a8b52
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09baa3
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:31:56.055571 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 9 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:31:59.144067 [ 5724 ] {a7c08add-7b29-4d14-8603-6bb53930815c} <Error> executeQuery: Code: 60. DB::Exception: Could not find table: test. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:56004) (in query: alter table test modify column v Variant(UInt64, String, Date) settings mutations_sync=1), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x000000000a941553
6. /build/src/Interpreters/InterpreterAlterQuery.cpp:124: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff7ee8
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
9. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
10. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:31:59.181857 [ 5724 ] {a7c08add-7b29-4d14-8603-6bb53930815c} <Error> TCPHandler: Code: 60. DB::Exception: Could not find table: test. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x000000000a941553
6. /build/src/Interpreters/InterpreterAlterQuery.cpp:124: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff7ee8
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
9. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
10. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:32:00.886766 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:00.909220 [ 5724 ] {6689c0d7-7534-4e52-9634-d28f2e473d8a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=936, jobs=828). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56016) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:32:01.033428 [ 5724 ] {6689c0d7-7534-4e52-9634-d28f2e473d8a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=936, jobs=828). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:32:03.573537 [ 5724 ] {5791602d-b22c-4eaf-968b-e3e381efe4dc} <Error> executeQuery: Code: 60. DB::Exception: Unknown table expression identifier 'test' in scope SELECT x, y, v, v.String, v.UInt64, v.Date FROM test ORDER BY x ASC. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:48492) (in query: select x, y, v, v.String, v.UInt64, v.Date from test order by x), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a8b52
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09baa3
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:32:03.587326 [ 5724 ] {5791602d-b22c-4eaf-968b-e3e381efe4dc} <Error> TCPHandler: Code: 60. DB::Exception: Unknown table expression identifier 'test' in scope SELECT x, y, v, v.String, v.UInt64, v.Date FROM test ORDER BY x ASC. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a8b52
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09baa3
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:32:03.696752 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:05.637039 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38ea0
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:05.749049 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/ags/fjyryeivymlvgjzmxrjtmgrkqpofg, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b30a5fdd-4cd3-4753-a27b-1c1357718842, upload has finished false.
2025.03.05 22:32:05.752007 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/ags/fjyryeivymlvgjzmxrjtmgrkqpofg, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b30a5fdd-4cd3-4753-a27b-1c1357718842, upload has finished false
2025.03.05 22:32:05.802129 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/ags/fjyryeivymlvgjzmxrjtmgrkqpofg, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b30a5fdd-4cd3-4753-a27b-1c1357718842, upload has finished false
2025.03.05 22:32:05.834022 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 25 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:06.420590 [ 5819 ] {a067d654-ba22-408e-85f7-0e91f9aa1e20} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48504) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:32:06.448000 [ 5819 ] {a067d654-ba22-408e-85f7-0e91f9aa1e20} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:32:07.007939 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:07.933927 [ 5724 ] {63786b50-32f1-49b3-aab6-f5a281c55d07} <Error> executeQuery: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:48510) (in query: insert into test select number, number, toDate(number) from numbers(15, 3)), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterInsertQuery.cpp:123: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b428512
10. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42a984
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:32:07.948778 [ 5724 ] {63786b50-32f1-49b3-aab6-f5a281c55d07} <Error> TCPHandler: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterInsertQuery.cpp:123: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b428512
10. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42a984
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:32:08.765556 [ 3550 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:11.141998 [ 5819 ] {c53bafbd-978a-4864-b80d-f7dd419ce55d} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48554) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:32:11.172242 [ 5819 ] {c53bafbd-978a-4864-b80d-f7dd419ce55d} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:32:12.223336 [ 5819 ] {f1cb9aaf-8087-4888-89d2-3f615be997b0} <Error> executeQuery: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:48570) (in query: insert into test select number, number, multiIf(number % 4 == 0, number, number % 4 == 1, 'str_' || toString(number), number % 4 == 2, toDate(number), NULL) from numbers(18, 4)), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterInsertQuery.cpp:123: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b428512
10. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42a984
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:32:12.245895 [ 5819 ] {f1cb9aaf-8087-4888-89d2-3f615be997b0} <Error> TCPHandler: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterInsertQuery.cpp:123: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b428512
10. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42a984
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:32:15.851635 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:16.197749 [ 5819 ] {84322426-f69d-4cf2-9a67-0787fa1e5e88} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42358) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:32:16.240859 [ 5819 ] {84322426-f69d-4cf2-9a67-0787fa1e5e88} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:32:16.461301 [ 4786 ] {f01fb0c6-1f92-4430-8d9c-67e947c5fb2e} <Error> executeQuery: Code: 60. DB::Exception: Unknown table expression identifier 'test' in scope SELECT x, y, v, v.String, v.UInt64, v.Date FROM test ORDER BY x ASC. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:42364) (in query: select x, y, v, v.String, v.UInt64, v.Date from test order by x), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a8b52
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09baa3
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:32:16.522260 [ 4786 ] {f01fb0c6-1f92-4430-8d9c-67e947c5fb2e} <Error> TCPHandler: Code: 60. DB::Exception: Unknown table expression identifier 'test' in scope SELECT x, y, v, v.String, v.UInt64, v.Date FROM test ORDER BY x ASC. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a8b52
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09baa3
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:32:19.864082 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/boy/hpkdeteuwxsnfbowwviatrrrnozio, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 29e99b6d-9b51-4cce-a485-6c15b0d9ee59, upload has finished false.
2025.03.05 22:32:19.869343 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/boy/hpkdeteuwxsnfbowwviatrrrnozio, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 29e99b6d-9b51-4cce-a485-6c15b0d9ee59, upload has finished false
2025.03.05 22:32:19.936191 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/boy/hpkdeteuwxsnfbowwviatrrrnozio, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 29e99b6d-9b51-4cce-a485-6c15b0d9ee59, upload has finished false
2025.03.05 22:32:20.007546 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 29 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:20.220208 [ 2811 ] {c8f29acf-0c38-4782-a32c-ee1a06d81f8f} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39190) (comment: 03217_filtering_in_system_tables.sql) (in query: -- argMax is necessary to make the test repeatable
 -- StorageSystemTables
 SELECT argMax(read_rows, event_time_microseconds) FROM system.query_log WHERE 1 AND current_database = currentDatabase() AND query LIKE '%SELECT database, table FROM system.tables WHERE database = \'information_schema\' AND table = \'tables\';' AND type = 'QueryFinish';), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:32:20.589079 [ 2811 ] {c8f29acf-0c38-4782-a32c-ee1a06d81f8f} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:32:20.678130 [ 4786 ] {3d1178e8-bdd1-4d0a-9c23-23465c9ba356} <Error> executeQuery: Code: 60. DB::Exception: Could not find table: test. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:42402) (in query: alter table test modify column y Variant(UInt64, String) settings mutations_sync=1), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x000000000a941553
6. /build/src/Interpreters/InterpreterAlterQuery.cpp:124: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff7ee8
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
9. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
10. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:32:20.715742 [ 4786 ] {3d1178e8-bdd1-4d0a-9c23-23465c9ba356} <Error> TCPHandler: Code: 60. DB::Exception: Could not find table: test. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x000000000a941553
6. /build/src/Interpreters/InterpreterAlterQuery.cpp:124: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff7ee8
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
9. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
10. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:32:23.969480 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:24.852141 [ 4786 ] {d56cee7d-9e6d-45fb-b942-091495353b9f} <Error> executeQuery: Code: 60. DB::Exception: Unknown table expression identifier 'test' in scope SELECT x, y, y.UInt64, y.String, v, v.String, v.UInt64, v.Date FROM test ORDER BY x ASC. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:47298) (in query: select x, y, y.UInt64, y.String, v, v.String, v.UInt64, v.Date from test order by x), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a8b52
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09baa3
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:32:24.897285 [ 4786 ] {d56cee7d-9e6d-45fb-b942-091495353b9f} <Error> TCPHandler: Code: 60. DB::Exception: Unknown table expression identifier 'test' in scope SELECT x, y, y.UInt64, y.String, v, v.String, v.UInt64, v.Date FROM test ORDER BY x ASC. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a8b52
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09baa3
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:32:26.606490 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:27.382018 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/qki/tmiqchdsbwtgqpmmddfaopppvdcuz, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id cd4584dc-cea4-4126-a6d9-b3ba5b582ccb, upload has finished false.
2025.03.05 22:32:27.383009 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/qki/tmiqchdsbwtgqpmmddfaopppvdcuz, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id cd4584dc-cea4-4126-a6d9-b3ba5b582ccb, upload has finished false
2025.03.05 22:32:27.393267 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/qki/tmiqchdsbwtgqpmmddfaopppvdcuz, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id cd4584dc-cea4-4126-a6d9-b3ba5b582ccb, upload has finished false
2025.03.05 22:32:27.575310 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 12 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:29.220054 [ 5819 ] {a43f1d5d-5ce4-4020-b500-6aa4dbf191df} <Error> executeQuery: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:47344) (in query: insert into test select number, multiIf(number % 3 == 0, number, number % 3 == 1, 'str_' || toString(number), NULL), NULL from numbers(22, 3)), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterInsertQuery.cpp:123: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b428512
10. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42a984
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:32:29.261499 [ 5819 ] {a43f1d5d-5ce4-4020-b500-6aa4dbf191df} <Error> TCPHandler: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterInsertQuery.cpp:123: DB::InterpreterInsertQuery::getTable(DB::ASTInsertQuery&) @ 0x000000001b428512
10. /build/src/Interpreters/InterpreterInsertQuery.cpp:406: DB::InterpreterInsertQuery::execute() @ 0x000000001b42a984
11. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
12. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
13. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:32:31.345286 [ 3923 ] {6aa2bd01-c6e1-4d2b-b67a-fadef11db39a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47362) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:32:31.438385 [ 3923 ] {6aa2bd01-c6e1-4d2b-b67a-fadef11db39a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:32:33.526917 [ 3923 ] {75d986da-447f-441f-86b4-c06928428c55} <Error> executeQuery: Code: 60. DB::Exception: Unknown table expression identifier 'test' in scope SELECT x, y, y.UInt64, y.String, v, v.String, v.UInt64, v.Date FROM test ORDER BY x ASC. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:48980) (in query: select x, y, y.UInt64, y.String, v, v.String, v.UInt64, v.Date from test order by x), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a8b52
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09baa3
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:32:33.549933 [ 3923 ] {75d986da-447f-441f-86b4-c06928428c55} <Error> TCPHandler: Code: 60. DB::Exception: Unknown table expression identifier 'test' in scope SELECT x, y, y.UInt64, y.String, v, v.String, v.UInt64, v.Date FROM test ORDER BY x ASC. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a8b52
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09baa3
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:32:35.046235 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/dyc/snvsrlaaanfftfwmjyxussfjpsttr, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e272ec35-f60b-4e54-afbb-42efd5d8a917, upload has finished false.
2025.03.05 22:32:35.048639 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/dyc/snvsrlaaanfftfwmjyxussfjpsttr, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e272ec35-f60b-4e54-afbb-42efd5d8a917, upload has finished false
2025.03.05 22:32:35.117496 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/dyc/snvsrlaaanfftfwmjyxussfjpsttr, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e272ec35-f60b-4e54-afbb-42efd5d8a917, upload has finished false
2025.03.05 22:32:35.183053 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=1): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 18 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:38.134976 [ 3780 ] {5e83b4a1-1c10-4447-8b8c-ddb0b58c3bbf} <Error> executeQuery: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:49016) (in query: drop table test;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:966: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6742d8
9. /build/src/Interpreters/InterpreterDropQuery.cpp:131: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr<DB::Context const>, DB::ASTDropQuery&, std::shared_ptr<DB::IDatabase>&, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>&) @ 0x000000001b03ad01
10. /build/src/Interpreters/InterpreterDropQuery.cpp:102: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000001b03a394
11. /build/src/Interpreters/InterpreterDropQuery.cpp:73: DB::InterpreterDropQuery::execute() @ 0x000000001b03994e
12. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
21. ? @ 0x00007f7a996d8ac3
22. ? @ 0x00007f7a9976a850

2025.03.05 22:32:38.159563 [ 3780 ] {5e83b4a1-1c10-4447-8b8c-ddb0b58c3bbf} <Error> TCPHandler: Code: 60. DB::Exception: Table test_3pn6rf7b.test does not exist. Maybe you meant test_15.test?. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/Databases/IDatabase.cpp:39: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144bcb
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:966: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6742d8
9. /build/src/Interpreters/InterpreterDropQuery.cpp:131: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr<DB::Context const>, DB::ASTDropQuery&, std::shared_ptr<DB::IDatabase>&, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>&) @ 0x000000001b03ad01
10. /build/src/Interpreters/InterpreterDropQuery.cpp:102: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000001b03a394
11. /build/src/Interpreters/InterpreterDropQuery.cpp:73: DB::InterpreterDropQuery::execute() @ 0x000000001b03994e
12. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
21. ? @ 0x00007f7a996d8ac3
22. ? @ 0x00007f7a9976a850

2025.03.05 22:32:42.286725 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {0d6617f8-564f-43ff-a6dc-a74b9f150261::202503_1_46_9}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:45: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce470d
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:46.777544 [ 5724 ] {6fa8e13f-c453-4366-9f09-54d0f5fa14e8} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=35, jobs=35). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53048) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:32:46.816134 [ 5724 ] {6fa8e13f-c453-4366-9f09-54d0f5fa14e8} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=35, jobs=35). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:32:47.144361 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {6cd90e1d-0955-4f5f-a660-a94482f8afc2::202503_1_36_7}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:47.985000 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {0d6617f8-564f-43ff-a6dc-a74b9f150261::202503_1_46_9}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:45: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce470d
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:48.081553 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:49.253604 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/vix/cejzonmhggwajppcwnccaqfzrxhfl, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 333a05ed-7ceb-42e0-809c-fa8f007faeb0, upload has finished false.
2025.03.05 22:32:49.255680 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/vix/cejzonmhggwajppcwnccaqfzrxhfl, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 333a05ed-7ceb-42e0-809c-fa8f007faeb0, upload has finished false
2025.03.05 22:32:49.320663 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/vix/cejzonmhggwajppcwnccaqfzrxhfl, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 333a05ed-7ceb-42e0-809c-fa8f007faeb0, upload has finished false
2025.03.05 22:32:49.401630 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 37 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:54.543702 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 7 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:56.722096 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:56.811131 [ 3780 ] {a88d58b1-8d97-4e25-ace4-c3cb5cacaf5f} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=29, jobs=29). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41096) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:32:56.907892 [ 3780 ] {a88d58b1-8d97-4e25-ace4-c3cb5cacaf5f} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=29, jobs=29). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:32:58.114028 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:32:58.276168 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:01.644821 [ 3780 ] {255f2433-f3a9-4e55-a0b6-1aebed6de80a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41116) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:33:01.653714 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 3 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:01.663821 [ 3780 ] {255f2433-f3a9-4e55-a0b6-1aebed6de80a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:33:06.499058 [ 3780 ] {5ed0c809-287f-4a35-99ce-828ed3dc76db} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=10). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54464) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:33:06.540210 [ 3780 ] {5ed0c809-287f-4a35-99ce-828ed3dc76db} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=10). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:33:07.889704 [ 3780 ] {867eee53-83b7-4cab-b73d-32492a1eaa10} <Error> executeQuery: Code: 43. DB::Exception: Illegal type AggregateFunction(groupArray(9223372036854775807), UInt32) of argument for aggregate function with Merge suffix. because it corresponds to different aggregate function: groupArray instead of groupArray. (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:54466) (comment: 01632_group_array_msan.sql) (in query: SELECT groupArrayMerge(1048577)(y * 1048576) FROM (SELECT groupArrayState(9223372036854775807)(x) AS y FROM (SELECT 1048576 AS x)) FORMAT Null;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/AggregateFunctions/Combinators/AggregateFunctionMerge.cpp:61: DB::(anonymous namespace)::AggregateFunctionCombinatorMerge::transformAggregateFunction(std::shared_ptr<DB::IAggregateFunction const> const&, DB::AggregateFunctionProperties const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&) const @ 0x000000001600a28c
7. /build/src/AggregateFunctions/AggregateFunctionFactory.cpp:249: DB::AggregateFunctionFactory::getImpl(String const&, DB::NullsAction, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x00000000190b9e32
8. /build/src/AggregateFunctions/AggregateFunctionFactory.cpp:123: DB::AggregateFunctionFactory::get(String const&, DB::NullsAction, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000190b8946
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5983: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0baddf
10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
16. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
19. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
27. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
28. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
29. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
30. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
31. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5

2025.03.05 22:33:07.899634 [ 3780 ] {867eee53-83b7-4cab-b73d-32492a1eaa10} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type AggregateFunction(groupArray(9223372036854775807), UInt32) of argument for aggregate function with Merge suffix. because it corresponds to different aggregate function: groupArray instead of groupArray. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/AggregateFunctions/Combinators/AggregateFunctionMerge.cpp:61: DB::(anonymous namespace)::AggregateFunctionCombinatorMerge::transformAggregateFunction(std::shared_ptr<DB::IAggregateFunction const> const&, DB::AggregateFunctionProperties const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&) const @ 0x000000001600a28c
7. /build/src/AggregateFunctions/AggregateFunctionFactory.cpp:249: DB::AggregateFunctionFactory::getImpl(String const&, DB::NullsAction, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x00000000190b9e32
8. /build/src/AggregateFunctions/AggregateFunctionFactory.cpp:123: DB::AggregateFunctionFactory::get(String const&, DB::NullsAction, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000190b8946
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5983: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0baddf
10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
16. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
19. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
27. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
28. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
29. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
30. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
31. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5

2025.03.05 22:33:09.096735 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/lwd/nyugkoaaachegtdakhbqgzlfmlrkx, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4385787a-a3c7-4f3c-bf0a-8f24b21eaa24, upload has finished false.
2025.03.05 22:33:09.098367 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/lwd/nyugkoaaachegtdakhbqgzlfmlrkx, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4385787a-a3c7-4f3c-bf0a-8f24b21eaa24, upload has finished false
2025.03.05 22:33:09.153117 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/lwd/nyugkoaaachegtdakhbqgzlfmlrkx, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4385787a-a3c7-4f3c-bf0a-8f24b21eaa24, upload has finished false
2025.03.05 22:33:09.291866 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 17 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:10.077139 [ 5724 ] {6f48e2a5-7320-41a6-a679-c589f3bf9f91} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54488) (in query: insert into test select number, number, 'str_' || toString(number) from numbers(6, 3)), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:45: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce470d
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975

2025.03.05 22:33:10.178550 [ 5724 ] {6f48e2a5-7320-41a6-a679-c589f3bf9f91} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:45: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce470d
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975

2025.03.05 22:33:10.648430 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:11.244141 [ 3780 ] {8f3741a9-dd84-4aaa-8c2a-e07f19c45cb9} <Error> executeQuery: Code: 43. DB::Exception: Illegal type AggregateFunction(quantileResample(0.1, 1, 2, 42), UInt64, UInt64) of argument for aggregate function with Merge suffix. because it corresponds to different aggregate function: quantileResample instead of quantileResample. (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:54466) (comment: 01632_group_array_msan.sql) (in query: SELECT quantileResampleMerge(0.5, 257, 65536, 1)(tuple(*).1) FROM (SELECT quantileResampleState(0.10, 1, 2, 42)(number, number) FROM numbers(100));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/AggregateFunctions/Combinators/AggregateFunctionMerge.cpp:61: DB::(anonymous namespace)::AggregateFunctionCombinatorMerge::transformAggregateFunction(std::shared_ptr<DB::IAggregateFunction const> const&, DB::AggregateFunctionProperties const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&) const @ 0x000000001600a28c
7. /build/src/AggregateFunctions/AggregateFunctionFactory.cpp:249: DB::AggregateFunctionFactory::getImpl(String const&, DB::NullsAction, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x00000000190b9e32
8. /build/src/AggregateFunctions/AggregateFunctionFactory.cpp:123: DB::AggregateFunctionFactory::get(String const&, DB::NullsAction, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000190b8946
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5983: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0baddf
10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
16. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
19. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
27. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
28. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
29. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
30. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
31. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5

2025.03.05 22:33:11.264219 [ 3780 ] {8f3741a9-dd84-4aaa-8c2a-e07f19c45cb9} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type AggregateFunction(quantileResample(0.1, 1, 2, 42), UInt64, UInt64) of argument for aggregate function with Merge suffix. because it corresponds to different aggregate function: quantileResample instead of quantileResample. (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&, String&&) @ 0x000000000aa258e4
6. /build/src/AggregateFunctions/Combinators/AggregateFunctionMerge.cpp:61: DB::(anonymous namespace)::AggregateFunctionCombinatorMerge::transformAggregateFunction(std::shared_ptr<DB::IAggregateFunction const> const&, DB::AggregateFunctionProperties const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&) const @ 0x000000001600a28c
7. /build/src/AggregateFunctions/AggregateFunctionFactory.cpp:249: DB::AggregateFunctionFactory::getImpl(String const&, DB::NullsAction, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&, bool) const @ 0x00000000190b9e32
8. /build/src/AggregateFunctions/AggregateFunctionFactory.cpp:123: DB::AggregateFunctionFactory::get(String const&, DB::NullsAction, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::Array const&, DB::AggregateFunctionProperties&) const @ 0x00000000190b8946
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5983: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0baddf
10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
16. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
19. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
27. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
28. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
29. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
30. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
31. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5

2025.03.05 22:33:11.410651 [ 5809 ] {6ce04ee7-0639-4e42-9557-aae8557022d6} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=16, jobs=16). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54490) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:33:11.489275 [ 5809 ] {6ce04ee7-0639-4e42-9557-aae8557022d6} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=16, jobs=16). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:33:15.956698 [ 5809 ] {9d6d953e-9f7c-4400-bcc5-caee4c77e3c4} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:52014) (comment: 02902_topKGeneric_deserialization_memory.sql) (in query: -- https://github.com/ClickHouse/ClickHouse/issues/49706
 -- Using format Parquet for convenience so it errors out without output (but still deserializes the output)
 -- Without the fix this would OOM the client when deserializing the state
 SELECT topKResampleState(1048576, 257, 65536, 10)(toString(number), number) FROM numbers(3) FORMAT Parquet;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:33:16.082814 [ 5809 ] {9d6d953e-9f7c-4400-bcc5-caee4c77e3c4} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:33:17.506968 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/dhp/iodwqsgctzojdkctvseldxilnhiaw, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e276d2c9-efb7-4130-aa01-1bd97f23c157, upload has finished false.
2025.03.05 22:33:17.516062 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/dhp/iodwqsgctzojdkctvseldxilnhiaw, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e276d2c9-efb7-4130-aa01-1bd97f23c157, upload has finished false
2025.03.05 22:33:17.574635 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/dhp/iodwqsgctzojdkctvseldxilnhiaw, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e276d2c9-efb7-4130-aa01-1bd97f23c157, upload has finished false
2025.03.05 22:33:17.672427 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 22 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:20.472406 [ 3780 ] {87305e07-2c63-43f6-808b-9a3ed260fbfc} <Warning> Context: Server has databases (for example `02988_ordinary`) with Ordinary engine, which was deprecated. To convert this database to the new Atomic engine, create a flag /var/lib/clickhouse/flags/convert_ordinary_to_atomic and make sure that ClickHouse has write permission for it. Example: sudo touch '/var/lib/clickhouse/flags/convert_ordinary_to_atomic' && sudo chmod 666 '/var/lib/clickhouse/flags/convert_ordinary_to_atomic'
2025.03.05 22:33:21.080321 [ 5724 ] {ff513890-6256-4906-b9c9-90f0bf5c1884} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:52062) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:33:21.441742 [ 5724 ] {ff513890-6256-4906-b9c9-90f0bf5c1884} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:33:21.442454 [ 5809 ] {a82f0d2f-b874-4344-bfb2-a679a05bf7f0} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=936, jobs=830). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:52050) (in query: insert into test select number, number, multiIf(number % 3 == 0, number, number % 3 == 1, 'str_' || toString(number), NULL) from numbers(12, 3)), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&) @ 0x000000001d511201
10. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:92: DB::CompletedPipelineExecutor::execute() @ 0x000000001d510e16
11. /build/src/Server/TCPHandler.cpp:566: DB::TCPHandler::runImpl() @ 0x000000001d46efb1
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:33:21.446054 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:21.541399 [ 5809 ] {a82f0d2f-b874-4344-bfb2-a679a05bf7f0} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=936, jobs=830). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&) @ 0x000000001d511201
10. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:92: DB::CompletedPipelineExecutor::execute() @ 0x000000001d510e16
11. /build/src/Server/TCPHandler.cpp:566: DB::TCPHandler::runImpl() @ 0x000000001d46efb1
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:33:23.812760 [ 5808 ] {72637a93-775d-4b5e-a8e1-b1582137fadd} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=3): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47370) (comment: 00180_no_seek_avoiding_when_reading_from_cache.sh) (in query: -- AsynchronousReaderIgnoredBytes = 0: no seek-avoiding happened
 -- CachedReadBufferReadFromSourceBytes = 0: sanity check to ensure we read only from cache
 SELECT ProfileEvents['AsynchronousReaderIgnoredBytes'], ProfileEvents['CachedReadBufferReadFromSourceBytes'] FROM system.query_log WHERE query_id = '02906_read_from_cache_23636' AND type = 'QueryFinish' AND event_date >= yesterday() AND current_database = currentDatabase() ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeReadTask.cpp:44: DB::MergeTreeReadTask::createReaders(std::shared_ptr<DB::MergeTreeReadTaskInfo const> const&, DB::MergeTreeReadTask::Extras const&, DB::MarkRanges const&)::$_0::operator()(DB::NamesAndTypesList const&) const @ 0x000000001ce975a7
29. /build/src/Storages/MergeTree/MergeTreeReadTask.cpp:64: DB::MergeTreeReadTask::createReaders(std::shared_ptr<DB::MergeTreeReadTaskInfo const> const&, DB::MergeTreeReadTask::Extras const&, DB::MarkRanges const&) @ 0x000000001ce973f5
30. /build/src/Storages/MergeTree/MergeTreeReadPoolBase.cpp:160: DB::MergeTreeReadPoolBase::createTask(std::shared_ptr<DB::MergeTreeReadTaskInfo const>, DB::MarkRanges, DB::MergeTreeReadTask*) const @ 0x000000001dda94ea
31. /build/src/Storages/MergeTree/MergeTreeReadPool.cpp:177: DB::MergeTreeReadPool::getTask(unsigned long, DB::MergeTreeReadTask*) @ 0x000000001dddc452

2025.03.05 22:33:23.921788 [ 5808 ] {72637a93-775d-4b5e-a8e1-b1582137fadd} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=3): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeReadTask.cpp:44: DB::MergeTreeReadTask::createReaders(std::shared_ptr<DB::MergeTreeReadTaskInfo const> const&, DB::MergeTreeReadTask::Extras const&, DB::MarkRanges const&)::$_0::operator()(DB::NamesAndTypesList const&) const @ 0x000000001ce975a7
29. /build/src/Storages/MergeTree/MergeTreeReadTask.cpp:64: DB::MergeTreeReadTask::createReaders(std::shared_ptr<DB::MergeTreeReadTaskInfo const> const&, DB::MergeTreeReadTask::Extras const&, DB::MarkRanges const&) @ 0x000000001ce973f5
30. /build/src/Storages/MergeTree/MergeTreeReadPoolBase.cpp:160: DB::MergeTreeReadPoolBase::createTask(std::shared_ptr<DB::MergeTreeReadTaskInfo const>, DB::MarkRanges, DB::MergeTreeReadTask*) const @ 0x000000001dda94ea
31. /build/src/Storages/MergeTree/MergeTreeReadPool.cpp:177: DB::MergeTreeReadPool::getTask(unsigned long, DB::MergeTreeReadTask*) @ 0x000000001dddc452

2025.03.05 22:33:23.975060 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:25.726258 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/bpr/eicaluzoenycbjkqvomxiytyhsksb, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b89d1a42-945d-4fc4-a22b-c1ec22abc95e, upload has finished false.
2025.03.05 22:33:25.733123 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/bpr/eicaluzoenycbjkqvomxiytyhsksb, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b89d1a42-945d-4fc4-a22b-c1ec22abc95e, upload has finished false
2025.03.05 22:33:25.770855 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/bpr/eicaluzoenycbjkqvomxiytyhsksb, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b89d1a42-945d-4fc4-a22b-c1ec22abc95e, upload has finished false
2025.03.05 22:33:25.823257 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 17 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:26.237338 [ 5809 ] {3b348e10-3820-4562-970b-2ace5eaad962} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48750) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:33:26.336832 [ 5809 ] {3b348e10-3820-4562-970b-2ace5eaad962} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:33:27.162567 [ 5819 ] {d65f03c6-d229-47ed-8d19-5088f78cd35a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=936, jobs=829). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48740) (comment: 00386_has_column_in_table.sql) (in query: SELECT hasColumnInTable('localhost', currentDatabase(), 'has_column_in_table', 's');), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:33:27.177842 [ 5819 ] {d65f03c6-d229-47ed-8d19-5088f78cd35a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=936, jobs=829). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:33:28.096891 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:30.441611 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_1_76_14}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:36.273206 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38ea0
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:37.166682 [ 3780 ] {32acb2ab-39d0-4184-acb9-40aafe7b18eb} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=25, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37542) (comment: 00097_constexpr_in_index.sql) (in query: -- Even in presence of OR, we evaluate the "0 IN (1, 2, 3)" as a constant expression therefore it does not prevent the index analysis.
 SELECT count() FROM test.hits WHERE CounterID IN (14917930, 33034174) OR 0 IN (1, 2, 3) SETTINGS max_rows_to_read = 1000000, force_primary_key = 1;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:33:37.456088 [ 3780 ] {32acb2ab-39d0-4184-acb9-40aafe7b18eb} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=25, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:33:37.867795 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/fnq/xchlclcurwrpjsevnlfvvivsgnzga, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 1ee415c6-1494-4d50-8e6c-5e93587871a8, upload has finished false.
2025.03.05 22:33:37.905054 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/fnq/xchlclcurwrpjsevnlfvvivsgnzga, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 1ee415c6-1494-4d50-8e6c-5e93587871a8, upload has finished false
2025.03.05 22:33:37.970032 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/fnq/xchlclcurwrpjsevnlfvvivsgnzga, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 1ee415c6-1494-4d50-8e6c-5e93587871a8, upload has finished false
2025.03.05 22:33:38.023917 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 26 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:39.200953 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:41.445563 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=1): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 3 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:41.923095 [ 5819 ] {9834981f-8e2f-4a01-9bd0-07fa943be54d} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37598) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:33:41.948389 [ 3780 ] {87129481-2435-4475-bf4d-0b5a9b1e0991} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37604) (comment: 00083_array_filter.sql) (in query: SELECT sum(length(ParsedParams.Key1)) FROM test.hits WHERE notEmpty(ParsedParams.Key1);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:33:41.966259 [ 3780 ] {87129481-2435-4475-bf4d-0b5a9b1e0991} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:33:41.983700 [ 5819 ] {9834981f-8e2f-4a01-9bd0-07fa943be54d} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:33:45.899643 [ 5809 ] {c2e21c37-e35f-418b-a59e-aadcc1514a73} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=936, jobs=828). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37554) (comment: 02016_bit_shift_right_for_string_integer.sql) (in query: SELECT 34,'Hello',bin(bitShiftRight('Hello', 34));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:33:45.922080 [ 5809 ] {c2e21c37-e35f-418b-a59e-aadcc1514a73} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=936, jobs=828). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:33:47.993588 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:49.645960 [ 5819 ] {d3d64092-3b9c-4a55-b8c4-d66c1acdaa86} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38360) (comment: 00141_transform.sql) (in query: SELECT transform(SearchEngineID, [2, 3], ['Яндекс', 'Google'], 'Остальные') AS title, count() AS c FROM test.hits WHERE SearchEngineID != 0 GROUP BY title HAVING c > 0 ORDER BY c DESC LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:33:50.249745 [ 5819 ] {d3d64092-3b9c-4a55-b8c4-d66c1acdaa86} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:33:53.275540 [ 3580 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Removing temporary directory /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:33:53.276174 [ 3580 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:33:53.355503 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/wkt/nfwwfbtptjumxmtyptpxoiezzvzve, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id da175f5b-4778-42ca-bd71-b2c999267c7c, upload has finished false.
2025.03.05 22:33:53.357881 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/wkt/nfwwfbtptjumxmtyptpxoiezzvzve, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id da175f5b-4778-42ca-bd71-b2c999267c7c, upload has finished false
2025.03.05 22:33:53.422883 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/wkt/nfwwfbtptjumxmtyptpxoiezzvzve, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id da175f5b-4778-42ca-bd71-b2c999267c7c, upload has finished false
2025.03.05 22:33:53.600787 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 31 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:57.145161 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {6cd90e1d-0955-4f5f-a660-a94482f8afc2::202503_1_41_8}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:57.702330 [ 3555 ] {6e7a208c-d2c5-420f-ae5f-69a9efa06e16::1_1_1_0_5} <Error> MutatePlainMergeTreeTask: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable)
2025.03.05 22:33:57.719030 [ 5724 ] {e7193f83-0aea-4693-8ceb-d54a076f4554} <Error> executeQuery: Code: 341. DB::Exception: Exception happened during execution of mutation 'mutation_5.txt' with part '1_1_1_0' reason: 'Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable)'. This error maybe retryable or not. In case of unretryable error, mutation can be killed with KILL MUTATION query. (UNFINISHED) (version 24.3.12.76.altinitystable) (from [::1]:38398) (comment: 02399_merge_tree_mutate_in_partition.sql) (in query: alter table mt update n = n + (n not in m) in partition id '1' where 1 settings mutations_sync=1;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, String, String&, String&>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<String&>::type, std::type_identity<String&>::type>, char const*&&, String&&, String&, String&) @ 0x000000001ce26c04
6. /build/src/Storages/MergeTree/MergeTreeMutationStatus.cpp:26: DB::checkMutationStatus(std::optional<DB::MergeTreeMutationStatus>&, std::set<String, std::less<String>, std::allocator<String>> const&) @ 0x000000001ce269a0
7. /build/src/Storages/StorageMergeTree.cpp:620: DB::StorageMergeTree::waitForMutation(long, String const&, bool) @ 0x000000001d0f2012
8. /build/src/Storages/StorageMergeTree.cpp:590: DB::StorageMergeTree::waitForMutation(long, bool) @ 0x000000001d0ef668
9. /build/src/Storages/StorageMergeTree.cpp:661: DB::StorageMergeTree::mutate(DB::MutationCommands const&, std::shared_ptr<DB::Context const>) @ 0x000000001d0f3869
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:221: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9600
11. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
12. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
21. ? @ 0x00007f7a996d8ac3
22. ? @ 0x00007f7a9976a850

2025.03.05 22:33:57.722908 [ 3555 ] {6e7a208c-d2c5-420f-ae5f-69a9efa06e16::1_1_1_0_5} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:57.732294 [ 5724 ] {e7193f83-0aea-4693-8ceb-d54a076f4554} <Error> TCPHandler: Code: 341. DB::Exception: Exception happened during execution of mutation 'mutation_5.txt' with part '1_1_1_0' reason: 'Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable)'. This error maybe retryable or not. In case of unretryable error, mutation can be killed with KILL MUTATION query. (UNFINISHED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, String, String&, String&>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<String&>::type, std::type_identity<String&>::type>, char const*&&, String&&, String&, String&) @ 0x000000001ce26c04
6. /build/src/Storages/MergeTree/MergeTreeMutationStatus.cpp:26: DB::checkMutationStatus(std::optional<DB::MergeTreeMutationStatus>&, std::set<String, std::less<String>, std::allocator<String>> const&) @ 0x000000001ce269a0
7. /build/src/Storages/StorageMergeTree.cpp:620: DB::StorageMergeTree::waitForMutation(long, String const&, bool) @ 0x000000001d0f2012
8. /build/src/Storages/StorageMergeTree.cpp:590: DB::StorageMergeTree::waitForMutation(long, bool) @ 0x000000001d0ef668
9. /build/src/Storages/StorageMergeTree.cpp:661: DB::StorageMergeTree::mutate(DB::MutationCommands const&, std::shared_ptr<DB::Context const>) @ 0x000000001d0f3869
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:221: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9600
11. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
12. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
21. ? @ 0x00007f7a996d8ac3
22. ? @ 0x00007f7a9976a850

2025.03.05 22:33:58.674802 [ 3551 ] {6e7a208c-d2c5-420f-ae5f-69a9efa06e16::1_1_1_0_5} <Error> MutatePlainMergeTreeTask: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable)
2025.03.05 22:33:58.684419 [ 3551 ] {6e7a208c-d2c5-420f-ae5f-69a9efa06e16::1_1_1_0_5} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:33:59.591451 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/etr/cbqxmqagmdyhibopfeugbhmbexjjw, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4a512d4b-f152-4887-8e08-a1f8c803f14d, upload has finished false.
2025.03.05 22:33:59.593091 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/etr/cbqxmqagmdyhibopfeugbhmbexjjw, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4a512d4b-f152-4887-8e08-a1f8c803f14d, upload has finished false
2025.03.05 22:33:59.619789 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/etr/cbqxmqagmdyhibopfeugbhmbexjjw, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4a512d4b-f152-4887-8e08-a1f8c803f14d, upload has finished false
2025.03.05 22:34:00.006493 [ 3780 ] {58fae435-02e0-4db2-b81e-eb65b302a072} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42834) (comment: 00041_aggregating_materialized_view.sql) (in query: INSERT INTO test.visits_null SELECT CounterID, StartDate, Sign, UserID FROM test.visits;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d511b1d
13. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d5119aa
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d511939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d51189d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'()::operator()() @ 0x000000001d5117a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5116f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5116d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5116a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:34:00.006064 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 12 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:00.319062 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {6cd90e1d-0955-4f5f-a660-a94482f8afc2::202503_1_41_8}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:00.537141 [ 3780 ] {58fae435-02e0-4db2-b81e-eb65b302a072} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d511b1d
13. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d5119aa
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d511939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d51189d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'()::operator()() @ 0x000000001d5117a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5116f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5116d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5116a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:34:01.472141 [ 3554 ] {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1} <Error> virtual void DB::CachedOnDiskWriteBufferFromFile::nextImpl(): Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:567: DB::WriteBufferFromS3::writePart(DB::WriteBufferFromS3::PartData&&) @ 0x000000001991336e
18. /build/src/IO/WriteBufferFromS3.cpp:370: DB::WriteBufferFromS3::writeMultipartUpload() @ 0x00000000199074b6
19. /build/src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::nextImpl() @ 0x0000000019906b7e
20. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
21. /build/src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:236: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x000000001a35cb46
22. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
23. /build/src/IO/WriteBufferFromFileDecorator.cpp:71: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x000000001a3579ad
24. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
25. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
26. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
27. /build/src/IO/WriteBuffer.h:76: DB::WriteBuffer::nextIfAtEnd() @ 0x000000000a92ff78
28. /build/src/IO/WriteBuffer.h:91: DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000a92fde0
29. /build/src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x0000000019ddbded
30. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
31. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:02.230418 [ 3554 ] {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key s3/jev/usphqtflmgmltpftsuttzvjbhyrvo, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2c48dffe-064a-4789-90bb-14f8b0414ce2, upload has finished false.
2025.03.05 22:34:02.232497 [ 3554 ] {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key s3/jev/usphqtflmgmltpftsuttzvjbhyrvo, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2c48dffe-064a-4789-90bb-14f8b0414ce2, upload has finished false
2025.03.05 22:34:02.268476 [ 3554 ] {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key s3/jev/usphqtflmgmltpftsuttzvjbhyrvo, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2c48dffe-064a-4789-90bb-14f8b0414ce2, upload has finished false
2025.03.05 22:34:02.689138 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:567: DB::WriteBufferFromS3::writePart(DB::WriteBufferFromS3::PartData&&) @ 0x000000001991336e
18. /build/src/IO/WriteBufferFromS3.cpp:370: DB::WriteBufferFromS3::writeMultipartUpload() @ 0x00000000199074b6
19. /build/src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::nextImpl() @ 0x0000000019906b7e
20. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
21. /build/src/Disks/IO/CachedOnDiskWriteBufferFromFile.cpp:236: DB::CachedOnDiskWriteBufferFromFile::nextImpl() @ 0x000000001a35cb46
22. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
23. /build/src/IO/WriteBufferFromFileDecorator.cpp:71: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x000000001a3579ad
24. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
25. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
26. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
27. /build/src/IO/WriteBuffer.h:76: DB::WriteBuffer::nextIfAtEnd() @ 0x000000000a92ff78
28. /build/src/IO/WriteBuffer.h:91: DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000a92fde0
29. /build/src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x0000000019ddbded
30. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
31. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:02.972212 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {5e48ed56-6275-4a44-9e37-e27bc88cee54::all_1_6_1_4}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:05.429943 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:05.851949 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {5e48ed56-6275-4a44-9e37-e27bc88cee54::all_1_6_1_4}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:45: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce470d
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedColumnOnlyOutputStream.cpp:69: DB::MergedColumnOnlyOutputStream::fillChecksums(std::shared_ptr<DB::IMergeTreeDataPart>&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3e41a
24. /build/src/Storages/MergeTree/MergeTask.cpp:657: DB::MergeTask::VerticalMergeStage::finalizeVerticalMergeForOneColumn() const @ 0x000000001cb6e0bd
25. /build/src/Storages/MergeTree/MergeTask.cpp:877: DB::MergeTask::VerticalMergeStage::executeVerticalMergeForAllColumns() const @ 0x000000001cb7156e
26. /build/src/Storages/MergeTree/MergeTask.cpp:829: DB::MergeTask::VerticalMergeStage::execute() @ 0x000000001cb712b8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:07.098155 [ 5819 ] {b1e983a7-6cb5-405e-bb7b-d0493be15ee3} <Error> executeQuery: Code: 57. DB::Exception: Table system.columns already exists. (TABLE_ALREADY_EXISTS) (version 24.3.12.76.altinitystable) (from [::1]:57628) (comment: 01445_create_table_as_table_function.sh) (in query: CREATE TABLE system.columns AS numbers(10);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Interpreters/InterpreterCreateQuery.cpp:1395: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x000000001b01ac84
7. /build/src/Interpreters/InterpreterCreateQuery.cpp:1313: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b017166
8. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe96
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:34:07.131545 [ 5819 ] {b1e983a7-6cb5-405e-bb7b-d0493be15ee3} <Error> TCPHandler: Code: 57. DB::Exception: Table system.columns already exists. (TABLE_ALREADY_EXISTS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Interpreters/InterpreterCreateQuery.cpp:1395: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x000000001b01ac84
7. /build/src/Interpreters/InterpreterCreateQuery.cpp:1313: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b017166
8. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe96
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:34:12.598303 [ 5819 ] {c3d226a8-3ae3-495d-b48a-f555a3ea595b} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:57678) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:34:12.632312 [ 5819 ] {c3d226a8-3ae3-495d-b48a-f555a3ea595b} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:34:16.767682 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:274: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf391c4
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:17.154432 [ 3923 ] {33960455-4f78-44f0-9e37-42a0126a733a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53030) (comment: 03174_split_parts_ranges_into_intersecting_and_non_intersecting_final_and_read-in-order_bug.sql) (in query: optimize table tab final;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:34:17.178873 [ 3923 ] {33960455-4f78-44f0-9e37-42a0126a733a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:34:17.432847 [ 3780 ] {3e68d995-7afd-475a-8002-fe09be8ae923} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=38, jobs=38). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37832) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:34:17.472379 [ 3780 ] {3e68d995-7afd-475a-8002-fe09be8ae923} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=38, jobs=38). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:34:19.397378 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/sbb/mwsogpofcsncjxnyqknchgefljqty, total size 268435456, count 268435456, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2b7cbb11-0fde-4e1d-9251-200f2d3082b0, upload has finished false.
2025.03.05 22:34:19.400373 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/sbb/mwsogpofcsncjxnyqknchgefljqty, total size 268435456, count 268435456, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2b7cbb11-0fde-4e1d-9251-200f2d3082b0, upload has finished false
2025.03.05 22:34:19.491098 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/sbb/mwsogpofcsncjxnyqknchgefljqty, total size 268435456, count 268435456, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2b7cbb11-0fde-4e1d-9251-200f2d3082b0, upload has finished false
2025.03.05 22:34:19.516808 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 56 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:22.325496 [ 4789 ] {059e7506-ab5c-43ec-add3-8f35b8d33324} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37866) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:34:22.349036 [ 4789 ] {059e7506-ab5c-43ec-add3-8f35b8d33324} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:34:23.121099 [ 5808 ] {b7bf313b-9515-4989-9521-9443a228b445} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:57624) (comment: 00021_2_select_with_in.sql) (in query: select sum(Sign) from test.visits where CounterID in (942285, 577322);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:34:23.301062 [ 5808 ] {b7bf313b-9515-4989-9521-9443a228b445} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:34:24.114632 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 6 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:27.033187 [ 5819 ] {b12f3690-f988-4aea-bd88-4760b6c125c6} <Error> executeQuery: Code: 48. DB::Exception: ATTACH ... FROM ... query is not supported for Memory table engine, because such tables do not store any data on disk. Use CREATE instead. (NOT_IMPLEMENTED) (version 24.3.12.76.altinitystable) (from [::1]:37852) (comment: 01188_attach_table_from_path.sql) (in query: attach table test from 'some/path' (n UInt8) engine=Memory;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Interpreters/InterpreterCreateQuery.cpp:1525: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x000000001b01d9a6
7. /build/src/Interpreters/InterpreterCreateQuery.cpp:1313: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b017166
8. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe96
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:34:27.052445 [ 5819 ] {b12f3690-f988-4aea-bd88-4760b6c125c6} <Error> TCPHandler: Code: 48. DB::Exception: ATTACH ... FROM ... query is not supported for Memory table engine, because such tables do not store any data on disk. Use CREATE instead. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Interpreters/InterpreterCreateQuery.cpp:1525: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x000000001b01d9a6
7. /build/src/Interpreters/InterpreterCreateQuery.cpp:1313: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b017166
8. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe96
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:34:27.361126 [ 5819 ] {7deef265-402e-4bdb-94b3-1e427d1757a5} <Error> executeQuery: Code: 481. DB::Exception: Data directory /etc/passwd must be inside /var/lib/clickhouse/user_files/ to attach it. (PATH_ACCESS_DENIED) (version 24.3.12.76.altinitystable) (from [::1]:37852) (comment: 01188_attach_table_from_path.sql) (in query: attach table test from '/etc/passwd' (s String) engine=File(TSVRaw);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Interpreters/InterpreterCreateQuery.cpp:1163: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b014327
7. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe96
8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
9. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
10. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:34:27.362713 [ 5809 ] {0d63de5e-c9d1-4d88-9b47-ec05ddc2aff4} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=22, jobs=22). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:45248) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:34:27.385480 [ 5809 ] {0d63de5e-c9d1-4d88-9b47-ec05ddc2aff4} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=22, jobs=22). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:34:27.389663 [ 5819 ] {7deef265-402e-4bdb-94b3-1e427d1757a5} <Error> TCPHandler: Code: 481. DB::Exception: Data directory /etc/passwd must be inside /var/lib/clickhouse/user_files/ to attach it. (PATH_ACCESS_DENIED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Interpreters/InterpreterCreateQuery.cpp:1163: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b014327
7. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe96
8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
9. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
10. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:34:27.586171 [ 5819 ] {2304c6dc-812a-4490-b36b-38b9493156d6} <Error> executeQuery: Code: 481. DB::Exception: Data directory /etc/passwd must be inside /var/lib/clickhouse/user_files/ to attach it. (PATH_ACCESS_DENIED) (version 24.3.12.76.altinitystable) (from [::1]:37852) (comment: 01188_attach_table_from_path.sql) (in query: attach table test from '../../../../../../../../../etc/passwd' (s String) engine=File(TSVRaw);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Interpreters/InterpreterCreateQuery.cpp:1163: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b014327
7. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe96
8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
9. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
10. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:34:27.603936 [ 5819 ] {2304c6dc-812a-4490-b36b-38b9493156d6} <Error> TCPHandler: Code: 481. DB::Exception: Data directory /etc/passwd must be inside /var/lib/clickhouse/user_files/ to attach it. (PATH_ACCESS_DENIED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Interpreters/InterpreterCreateQuery.cpp:1163: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b014327
7. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe96
8. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
9. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
10. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:34:29.109981 [ 5819 ] {78618c4d-2af5-42fd-9ace-a132cc811da0} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=46, jobs=46). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37852) (comment: 01188_attach_table_from_path.sql) (in query: select * from file;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:34:29.218539 [ 5819 ] {78618c4d-2af5-42fd-9ace-a132cc811da0} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=46, jobs=46). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:34:29.558293 [ 3780 ] {0d0bc315-7c81-4578-8c5f-512acf0bf5e3} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:45246) (comment: 03174_low_cardinality_group_by_distributed_plan.sql) (in query: SELECT concatWithSeparator('.', toUInt128(6), '666' as b, materialize(toLowCardinality(8))) FROM remote('127.0.0.{1,1}', 'system.one') GROUP BY '666';), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:34:29.790047 [ 3780 ] {0d0bc315-7c81-4578-8c5f-512acf0bf5e3} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:34:30.114406 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 11 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:32.408294 [ 3780 ] {f8587d19-e155-4e7a-9ebd-afab7849bcce} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:45298) (in query: select x, y, y.UInt64, y.String, v, v.String, v.UInt64, v.Date from test order by x), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:34:32.422304 [ 3780 ] {f8587d19-e155-4e7a-9ebd-afab7849bcce} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:34:35.715030 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 12 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:37.227662 [ 5809 ] {16d08717-a34c-43bf-89fe-d3366240a3bb} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42502) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:34:37.289711 [ 5809 ] {16d08717-a34c-43bf-89fe-d3366240a3bb} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:34:38.274673 [ 3610 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:44.947666 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:47.241373 [ 5809 ] {c874f55e-fd0b-45d5-9e57-a4262144765b} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=20, jobs=10). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54542) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:34:47.256962 [ 5809 ] {c874f55e-fd0b-45d5-9e57-a4262144765b} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=20, jobs=10). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:34:47.361934 [ 5808 ] {909920e0-a90b-4ed3-b209-e5dd6bc8fc0f} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=8): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:45264) (comment: 00050_min_max.sql) (in query: SELECT CounterID, min(WatchID), max(WatchID) FROM test.hits GROUP BY CounterID ORDER BY count() DESC LIMIT 20;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:34:47.406564 [ 4786 ] {78866c6d-fc76-4898-a2d7-900bcb748829} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54548) (comment: 03169_optimize_injective_functions_inside_uniq_crash.sql) (in query: SELECT sum(u) FROM ( SELECT intDiv(number, 4096) AS k, uniqCombined(tuple(materialize(toLowCardinality(toNullable(16))))) AS u FROM numbers(4096 * 100) GROUP BY k ) SETTINGS allow_experimental_analyzer = 1, optimize_injective_functions_inside_uniq=0;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:34:47.484382 [ 4786 ] {78866c6d-fc76-4898-a2d7-900bcb748829} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:34:47.878450 [ 5808 ] {909920e0-a90b-4ed3-b209-e5dd6bc8fc0f} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=8): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:34:48.387841 [ 3552 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/omh/gfqmomceqistldqywohruinqdtfjv, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 1fb6257e-d572-47e6-87ed-786bf931d2e6, upload has finished false.
2025.03.05 22:34:48.391326 [ 3552 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/omh/gfqmomceqistldqywohruinqdtfjv, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 1fb6257e-d572-47e6-87ed-786bf931d2e6, upload has finished false
2025.03.05 22:34:48.574055 [ 3552 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/omh/gfqmomceqistldqywohruinqdtfjv, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 1fb6257e-d572-47e6-87ed-786bf931d2e6, upload has finished false
2025.03.05 22:34:48.638673 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 36 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:51.764629 [ 4786 ] {b38d9e81-c8ac-4e66-aa3b-59bc1a835d5b} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=936, jobs=828). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54576) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:34:51.783261 [ 4786 ] {b38d9e81-c8ac-4e66-aa3b-59bc1a835d5b} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=936, jobs=828). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:34:52.048967 [ 4789 ] {fff6960a-d661-497e-b254-e1cc2c293428} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=15, jobs=15). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54582) (comment: 02347_rank_corr_size_overflow.sql) (in query: SELECT round(rankCorr(number, -number)) FROM numbers(5000000);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:34:52.080281 [ 4789 ] {fff6960a-d661-497e-b254-e1cc2c293428} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=15, jobs=15). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:34:52.890009 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:53.666916 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38ea0
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:34:59.475549 [ 4789 ] {668006c7-f681-4dca-af36-1d1ff028733f} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:35108) (comment: 01710_projection_row_policy.sql) (in query: INSERT INTO t SELECT number % 10, number FROM numbers(10000);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:45: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce470d
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975

2025.03.05 22:34:59.482907 [ 4789 ] {668006c7-f681-4dca-af36-1d1ff028733f} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:45: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce470d
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975

2025.03.05 22:35:02.167265 [ 5724 ] {44eda221-41f4-48f0-87aa-5b991c5276a3} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:35116) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:35:02.228859 [ 5724 ] {44eda221-41f4-48f0-87aa-5b991c5276a3} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:35:03.493988 [ 5724 ] {8c98716e-51c6-4da0-810e-2a2397254193} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59320) (comment: 00079_array_join_not_used_joined_column.sql) (in query: SELECT PP.Key1 AS `ym:s:paramsLevel1`, sum(arrayAll(`x_1` -> `x_1`= '', ParsedParams.Key2)) AS `ym:s:visits` FROM test.hits ARRAY JOIN ParsedParams AS `PP` WHERE CounterID = 1704509 GROUP BY `ym:s:paramsLevel1` ORDER BY PP.Key1, `ym:s:visits` LIMIT 0, 100;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:35:03.542530 [ 5724 ] {8c98716e-51c6-4da0-810e-2a2397254193} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:35:04.998772 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column IsBounce): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_5_5_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6739): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:05.035370 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {6cd90e1d-0955-4f5f-a660-a94482f8afc2::202503_1_46_9}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:06.484035 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/nzl/rmfwitxvignnvdgpzwbuewhpuxmvo, total size 285212672, count 285212672, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4155e590-8f93-44d9-9725-85803a469a6e, upload has finished false.
2025.03.05 22:35:06.488308 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/nzl/rmfwitxvignnvdgpzwbuewhpuxmvo, total size 285212672, count 285212672, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4155e590-8f93-44d9-9725-85803a469a6e, upload has finished false
2025.03.05 22:35:06.597415 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/nzl/rmfwitxvignnvdgpzwbuewhpuxmvo, total size 285212672, count 285212672, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4155e590-8f93-44d9-9725-85803a469a6e, upload has finished false
2025.03.05 22:35:06.705050 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 59 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:06.743540 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7a26c9c9-7195-4e8c-807c-8ccd93ff5af2::202503_1_60_11}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:07.293924 [ 3780 ] {1616402b-f8b2-4ec0-b214-c8c7f7caf0a9} <Error> executeQuery: Code: 42. DB::Exception: Number of arguments for function addDate doesn't match: passed 1, should be 2: In scope SELECT addDate(CAST('2022-05-07', 'Date')). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 24.3.12.76.altinitystable) (from [::1]:59324) (comment: 02834_add_sub_date_functions.sql) (in query: SELECT addDate('2022-05-07'::Date);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, String&&, unsigned long&, unsigned long&) @ 0x0000000016b79368
6. /build/src/Functions/IFunction.cpp:431: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x000000001906396f
7. /build/src/Functions/IFunction.cpp:497: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063e36
8. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
9. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
17. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
19. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
20. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
28. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
29. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
30. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
31. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60

2025.03.05 22:35:07.306059 [ 3780 ] {1616402b-f8b2-4ec0-b214-c8c7f7caf0a9} <Error> TCPHandler: Code: 42. DB::Exception: Number of arguments for function addDate doesn't match: passed 1, should be 2: In scope SELECT addDate(CAST('2022-05-07', 'Date')). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, String&&, unsigned long&, unsigned long&) @ 0x0000000016b79368
6. /build/src/Functions/IFunction.cpp:431: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x000000001906396f
7. /build/src/Functions/IFunction.cpp:497: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063e36
8. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
9. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
17. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
19. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
20. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
28. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
29. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
30. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
31. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60

2025.03.05 22:35:07.329460 [ 5724 ] {ea3002dc-e784-4419-b427-dba0cdb9b99b} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=42, jobs=42). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59332) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:35:07.362532 [ 5724 ] {ea3002dc-e784-4419-b427-dba0cdb9b99b} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=42, jobs=42). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:35:07.502788 [ 3780 ] {ddc7d569-1c34-4a1a-bf5a-16988d5e88e6} <Error> executeQuery: Code: 42. DB::Exception: Number of arguments for function addDate doesn't match: passed 3, should be 2: In scope SELECT addDate(CAST('2022-05-07', 'Date'), toIntervalMinute(5), 5). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 24.3.12.76.altinitystable) (from [::1]:59324) (comment: 02834_add_sub_date_functions.sql) (in query: SELECT addDate('2022-05-07'::Date, INTERVAL 5 MINUTE, 5);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, String&&, unsigned long&, unsigned long&) @ 0x0000000016b79368
6. /build/src/Functions/IFunction.cpp:431: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x000000001906396f
7. /build/src/Functions/IFunction.cpp:497: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063e36
8. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
9. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
17. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
19. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
20. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
28. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
29. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
30. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
31. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60

2025.03.05 22:35:07.515124 [ 3780 ] {ddc7d569-1c34-4a1a-bf5a-16988d5e88e6} <Error> TCPHandler: Code: 42. DB::Exception: Number of arguments for function addDate doesn't match: passed 3, should be 2: In scope SELECT addDate(CAST('2022-05-07', 'Date'), toIntervalMinute(5), 5). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, String&&, unsigned long&, unsigned long&) @ 0x0000000016b79368
6. /build/src/Functions/IFunction.cpp:431: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x000000001906396f
7. /build/src/Functions/IFunction.cpp:497: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063e36
8. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
9. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
17. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
19. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
20. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
28. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
29. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
30. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
31. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60

2025.03.05 22:35:08.038086 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:08.045854 [ 3780 ] {1a437f89-595a-4d21-bc3c-99929583f5bc} <Error> executeQuery: Code: 43. DB::Exception: Illegal type UInt8 of 2nd argument of function addDate. Should be an interval: In scope SELECT addDate(CAST('2022-05-07', 'Date'), 10). (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:59324) (comment: 02834_add_sub_date_functions.sql) (in query: SELECT addDate('2022-05-07'::Date, 10);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Functions/FunctionsOpDate.cpp:42: DB::(anonymous namespace)::FunctionOpDate<DB::AddDate>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000b4f2be4
7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000af68950
8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000190641e7
9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
18. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
19. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
21. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
29. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
30. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
31. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa

2025.03.05 22:35:08.057549 [ 3780 ] {1a437f89-595a-4d21-bc3c-99929583f5bc} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type UInt8 of 2nd argument of function addDate. Should be an interval: In scope SELECT addDate(CAST('2022-05-07', 'Date'), 10). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Functions/FunctionsOpDate.cpp:42: DB::(anonymous namespace)::FunctionOpDate<DB::AddDate>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000b4f2be4
7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000af68950
8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000190641e7
9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
18. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
19. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
21. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
29. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
30. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
31. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa

2025.03.05 22:35:08.130586 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {9f912096-7afb-496b-86c7-16abf59bb4e4::202503_1_65_13}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:08.577063 [ 3780 ] {4a47cdfb-712f-4a7a-b4c6-ed8d7e12044d} <Error> executeQuery: Code: 43. DB::Exception: Illegal type Float64 of 1st argument of function addDate. Should be a date, a date with time or a string: In scope SELECT addDate(1.2, toIntervalMinute(5)). (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:59324) (comment: 02834_add_sub_date_functions.sql) (in query: SELECT addDate(1.2, INTERVAL 5 MINUTE);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Functions/FunctionsOpDate.cpp:35: DB::(anonymous namespace)::FunctionOpDate<DB::AddDate>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000b4f2a5d
7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000af68950
8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000190641e7
9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
18. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
19. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
21. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
29. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
30. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
31. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa

2025.03.05 22:35:08.614725 [ 3780 ] {4a47cdfb-712f-4a7a-b4c6-ed8d7e12044d} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type Float64 of 1st argument of function addDate. Should be a date, a date with time or a string: In scope SELECT addDate(1.2, toIntervalMinute(5)). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Functions/FunctionsOpDate.cpp:35: DB::(anonymous namespace)::FunctionOpDate<DB::AddDate>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000b4f2a5d
7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000af68950
8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000190641e7
9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
18. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
19. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
21. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
29. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
30. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
31. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa

2025.03.05 22:35:09.029276 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {6cd90e1d-0955-4f5f-a660-a94482f8afc2::202503_1_46_9}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x00000000132e996c
6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e6d5f
7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013255905
8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13e718
9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13de76
10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba8a15
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba89dd
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:09.048457 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:09.592002 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7a26c9c9-7195-4e8c-807c-8ccd93ff5af2::202503_1_60_11}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:10.949610 [ 3780 ] {249c23eb-4d7d-435d-bc35-cd687045c612} <Error> executeQuery: Code: 42. DB::Exception: Number of arguments for function subDate doesn't match: passed 1, should be 2: In scope SELECT subDate(CAST('2022-05-07', 'Date')). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 24.3.12.76.altinitystable) (from [::1]:59324) (comment: 02834_add_sub_date_functions.sql) (in query: SELECT subDate('2022-05-07'::Date);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, String&&, unsigned long&, unsigned long&) @ 0x0000000016b79368
6. /build/src/Functions/IFunction.cpp:431: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x000000001906396f
7. /build/src/Functions/IFunction.cpp:497: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063e36
8. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
9. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
17. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
19. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
20. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
28. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
29. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
30. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
31. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60

2025.03.05 22:35:10.983748 [ 3780 ] {249c23eb-4d7d-435d-bc35-cd687045c612} <Error> TCPHandler: Code: 42. DB::Exception: Number of arguments for function subDate doesn't match: passed 1, should be 2: In scope SELECT subDate(CAST('2022-05-07', 'Date')). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, String&&, unsigned long&, unsigned long&) @ 0x0000000016b79368
6. /build/src/Functions/IFunction.cpp:431: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x000000001906396f
7. /build/src/Functions/IFunction.cpp:497: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063e36
8. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
9. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
17. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
19. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
20. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
28. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
29. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
30. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
31. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60

2025.03.05 22:35:11.140586 [ 3780 ] {8d14982c-fb04-48ea-89df-55e9cc48478c} <Error> executeQuery: Code: 42. DB::Exception: Number of arguments for function subDate doesn't match: passed 3, should be 2: In scope SELECT subDate(CAST('2022-05-07', 'Date'), toIntervalMinute(5), 5). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH) (version 24.3.12.76.altinitystable) (from [::1]:59324) (comment: 02834_add_sub_date_functions.sql) (in query: SELECT subDate('2022-05-07'::Date, INTERVAL 5 MINUTE, 5);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, String&&, unsigned long&, unsigned long&) @ 0x0000000016b79368
6. /build/src/Functions/IFunction.cpp:431: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x000000001906396f
7. /build/src/Functions/IFunction.cpp:497: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063e36
8. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
9. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
17. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
19. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
20. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
28. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
29. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
30. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
31. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60

2025.03.05 22:35:11.159928 [ 3780 ] {8d14982c-fb04-48ea-89df-55e9cc48478c} <Error> TCPHandler: Code: 42. DB::Exception: Number of arguments for function subDate doesn't match: passed 3, should be 2: In scope SELECT subDate(CAST('2022-05-07', 'Date'), toIntervalMinute(5), 5). (NUMBER_OF_ARGUMENTS_DOESNT_MATCH), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, unsigned long&, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<unsigned long&>::type, std::type_identity<unsigned long&>::type>, String&&, unsigned long&, unsigned long&) @ 0x0000000016b79368
6. /build/src/Functions/IFunction.cpp:431: DB::IFunctionOverloadResolver::checkNumberOfArguments(unsigned long) const @ 0x000000001906396f
7. /build/src/Functions/IFunction.cpp:497: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063e36
8. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
9. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
17. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
19. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
20. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
28. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
29. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
30. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
31. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60

2025.03.05 22:35:11.652681 [ 3780 ] {5b8d482d-ca13-4cca-9bf5-8136053ec2e9} <Error> executeQuery: Code: 43. DB::Exception: Illegal type UInt8 of 2nd argument of function subDate. Should be an interval: In scope SELECT subDate(CAST('2022-05-07', 'Date'), 10). (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:59324) (comment: 02834_add_sub_date_functions.sql) (in query: SELECT subDate('2022-05-07'::Date, 10);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Functions/FunctionsOpDate.cpp:42: DB::(anonymous namespace)::FunctionOpDate<DB::SubDate>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000b4f4344
7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000af68950
8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000190641e7
9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
18. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
19. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
21. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
29. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
30. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
31. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa

2025.03.05 22:35:11.671270 [ 3780 ] {5b8d482d-ca13-4cca-9bf5-8136053ec2e9} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type UInt8 of 2nd argument of function subDate. Should be an interval: In scope SELECT subDate(CAST('2022-05-07', 'Date'), 10). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Functions/FunctionsOpDate.cpp:42: DB::(anonymous namespace)::FunctionOpDate<DB::SubDate>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000b4f4344
7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000af68950
8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000190641e7
9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
18. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
19. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
21. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
29. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
30. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
31. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa

2025.03.05 22:35:11.751325 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:12.101576 [ 4789 ] {f27ecb52-0416-4093-921c-c647d20bfd82} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59364) (comment: 00148_monotonic_functions_and_index.sql) (in query: SELECT count() FROM test.hits WHERE toUInt32(CounterID) = 1731;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:35:12.115177 [ 3780 ] {cd9d46a6-3129-4f23-aa90-b6926df5086e} <Error> executeQuery: Code: 43. DB::Exception: Illegal type Float64 of 1st argument of function subDate. Should be a date, a date with time or a string: In scope SELECT subDate(1.2, toIntervalMinute(5)). (ILLEGAL_TYPE_OF_ARGUMENT) (version 24.3.12.76.altinitystable) (from [::1]:59324) (comment: 02834_add_sub_date_functions.sql) (in query: SELECT subDate(1.2, INTERVAL 5 MINUTE);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Functions/FunctionsOpDate.cpp:35: DB::(anonymous namespace)::FunctionOpDate<DB::SubDate>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000b4f41bd
7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000af68950
8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000190641e7
9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
18. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
19. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
21. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
29. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
30. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
31. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa

2025.03.05 22:35:12.130627 [ 3780 ] {cd9d46a6-3129-4f23-aa90-b6926df5086e} <Error> TCPHandler: Code: 43. DB::Exception: Illegal type Float64 of 1st argument of function subDate. Should be a date, a date with time or a string: In scope SELECT subDate(1.2, toIntervalMinute(5)). (ILLEGAL_TYPE_OF_ARGUMENT), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Functions/FunctionsOpDate.cpp:35: DB::(anonymous namespace)::FunctionOpDate<DB::SubDate>::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000b4f41bd
7. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000af68950
8. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000190641e7
9. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
10. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
18. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
19. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
21. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
29. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
30. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
31. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa

2025.03.05 22:35:12.211369 [ 4789 ] {f27ecb52-0416-4093-921c-c647d20bfd82} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:35:12.468300 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 10 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:12.579307 [ 4786 ] {b36bc4d1-9fd3-416c-b987-52f1016e4b1b} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=44, jobs=44). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59372) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:35:12.632943 [ 4786 ] {b36bc4d1-9fd3-416c-b987-52f1016e4b1b} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=44, jobs=44). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:35:15.659458 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:16.660370 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 4 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:16.982758 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:17.029844 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:17.891410 [ 3780 ] {e424ce16-1598-446f-a89a-198a7c43cd8f} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34278) (comment: 02515_aggregate_functions_statistics.sql) (in query: SELECT corrMatrix(a_value) FROM (select a_value from fh limit 0);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:35:17.908943 [ 3780 ] {e424ce16-1598-446f-a89a-198a7c43cd8f} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:35:20.437562 [ 3587 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Removing temporary directory /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:35:20.438534 [ 3587 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:35:20.778773 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 6 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:21.554320 [ 3923 ] {3e88b485-7332-4da0-b5c6-84b804289dde} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=936, jobs=828). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34274) (comment: 00178_quantile_ddsketch.sql) (in query: SELECT CounterID AS k, round(quantileDD(0.01, 0.5)(ResolutionWidth), 2) FROM test.hits GROUP BY k ORDER BY count() DESC, CounterID LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:35:21.701591 [ 3923 ] {3e88b485-7332-4da0-b5c6-84b804289dde} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=936, jobs=828). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:35:22.142022 [ 3582 ] {} <Warning> system.trace_log (0d6617f8-564f-43ff-a6dc-a74b9f150261): Removing temporary directory /var/lib/clickhouse/disks/s3/store/0d6/0d6617f8-564f-43ff-a6dc-a74b9f150261/tmp_merge_202503_1_62_12/
2025.03.05 22:35:22.142626 [ 3582 ] {} <Warning> system.trace_log (0d6617f8-564f-43ff-a6dc-a74b9f150261): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/0d6/0d6617f8-564f-43ff-a6dc-a74b9f150261/tmp_merge_202503_1_62_12/
2025.03.05 22:35:22.178380 [ 5808 ] {ff5b7e4e-4cc6-4f22-9b0c-14010df969fc} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=39, jobs=39). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34294) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:35:22.227947 [ 5808 ] {ff5b7e4e-4cc6-4f22-9b0c-14010df969fc} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=39, jobs=39). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:35:22.376361 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {0d6617f8-564f-43ff-a6dc-a74b9f150261::202503_1_62_12}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:45: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce470d
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:22.518018 [ 5809 ] {5c429bc2-be1d-436a-a775-5195a681f06a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34308) (comment: 02715_or_null.sql) (in query: SELECT argMaxOrNull(id, timestamp) FROM ( SELECT CAST(NULL, 'Nullable(UInt32)') AS id, 2 AS timestamp );), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:35:22.537590 [ 5809 ] {5c429bc2-be1d-436a-a775-5195a681f06a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:35:27.605836 [ 4789 ] {a88ba486-4f1a-4766-bb66-22e202bd9a8f} <Error> executeQuery: Code: 48. DB::Exception: Can't execute any of specified algorithms for specified strictness/kind and right storage type. (NOT_IMPLEMENTED) (version 24.3.12.76.altinitystable) (from [::1]:36950) (comment: 00063_loyalty_joins.sql) (in query: SELECT loyalty, count() FROM test.hits ANY LEFT JOIN ( SELECT UserID, sum(SearchEngineID = 2) AS yandex, sum(SearchEngineID = 3) AS google, toInt8(if(yandex > google, yandex / (yandex + google), -google / (yandex + google)) * 10) AS loyalty FROM test.hits WHERE (SearchEngineID = 2) OR (SearchEngineID = 3) GROUP BY UserID HAVING (yandex + google) > 10 ) USING UserID GROUP BY loyalty ORDER BY loyalty ASC;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Planner/PlannerJoins.cpp:891: DB::chooseJoinAlgorithm(std::shared_ptr<DB::TableJoin>&, std::shared_ptr<DB::IQueryTreeNode> const&, DB::Block const&, DB::Block const&, std::shared_ptr<DB::PlannerContext> const&) @ 0x000000001b5c37fe
7. /build/src/Planner/PlannerJoinTree.cpp:1361: DB::(anonymous namespace)::buildQueryPlanForJoinNode(std::shared_ptr<DB::IQueryTreeNode> const&, DB::JoinTreeQueryPlan, DB::JoinTreeQueryPlan, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&, std::shared_ptr<DB::PlannerContext>&) @ 0x000000001b556b13
8. /build/src/Planner/PlannerJoinTree.cpp:1721: DB::buildJoinTreeQueryPlan(std::shared_ptr<DB::IQueryTreeNode> const&, DB::SelectQueryInfo const&, DB::SelectQueryOptions&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&, std::shared_ptr<DB::PlannerContext>&) @ 0x000000001b54dac5
9. /build/src/Planner/Planner.cpp:1473: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50e306
10. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50a455
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50765d
12. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0e12
13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
21. ? @ 0x00007f7a996d8ac3
22. ? @ 0x00007f7a9976a850

2025.03.05 22:35:27.766180 [ 4789 ] {a88ba486-4f1a-4766-bb66-22e202bd9a8f} <Error> TCPHandler: Code: 48. DB::Exception: Can't execute any of specified algorithms for specified strictness/kind and right storage type. (NOT_IMPLEMENTED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Planner/PlannerJoins.cpp:891: DB::chooseJoinAlgorithm(std::shared_ptr<DB::TableJoin>&, std::shared_ptr<DB::IQueryTreeNode> const&, DB::Block const&, DB::Block const&, std::shared_ptr<DB::PlannerContext> const&) @ 0x000000001b5c37fe
7. /build/src/Planner/PlannerJoinTree.cpp:1361: DB::(anonymous namespace)::buildQueryPlanForJoinNode(std::shared_ptr<DB::IQueryTreeNode> const&, DB::JoinTreeQueryPlan, DB::JoinTreeQueryPlan, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&, std::shared_ptr<DB::PlannerContext>&) @ 0x000000001b556b13
8. /build/src/Planner/PlannerJoinTree.cpp:1721: DB::buildJoinTreeQueryPlan(std::shared_ptr<DB::IQueryTreeNode> const&, DB::SelectQueryInfo const&, DB::SelectQueryOptions&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&, std::shared_ptr<DB::PlannerContext>&) @ 0x000000001b54dac5
9. /build/src/Planner/Planner.cpp:1473: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50e306
10. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50a455
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50765d
12. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0e12
13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
21. ? @ 0x00007f7a996d8ac3
22. ? @ 0x00007f7a9976a850

2025.03.05 22:35:30.462196 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:33.113188 [ 5808 ] {3db1026b-12bc-4740-8c89-08f7930f02a9} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:40844) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:35:33.144099 [ 5808 ] {3db1026b-12bc-4740-8c89-08f7930f02a9} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:35:33.560548 [ 4786 ] {51169ead-2d45-4c40-b03e-0c5070487fb4} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 216.26 MiB (attempt to allocate chunk of 1054720 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 24.3.12.76.altinitystable) (from [::1]:34258) (comment: 00038_uniq_state_merge2.sql) (in query: SELECT topLevelDomain(concat('http://', k)) AS tld, sum(u) AS u, uniqMerge(us) AS us FROM (SELECT domain(URL) AS k, uniq(UserID) AS u, uniqState(UserID) AS us FROM test.hits GROUP BY k) GROUP BY tld ORDER BY u DESC, tld ASC LIMIT 100 ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000132e9d7a
6. /build/src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e7feb
7. /build/src/Common/MemoryTracker.cpp:398: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e8862
8. /build/src/Common/CurrentMemoryTracker.cpp:58: CurrentMemoryTracker::allocImpl(long, bool) @ 0x00000000132554f1
9. /build/src/Common/CurrentMemoryTracker.cpp:90: CurrentMemoryTracker::alloc(long) @ 0x0000000013255701
10. /build/src/Common/Allocator.cpp:114: Allocator<true, true>::alloc(unsigned long, unsigned long) @ 0x0000000013253e26
11. /build/src/Common/HashTable/HashTable.h:522: HashTable<StringRef, StringHashMapCell<StringRef, char*>, StringHashTableHash, StringHashTableGrower<8ul>, Allocator<true, true>>::alloc(StringHashTableGrower<8ul> const&) @ 0x000000001ac1c8d9
12. /build/src/Common/HashTable/HashTable.h:768: HashTable<StringRef, StringHashMapCell<StringRef, char*>, StringHashTableHash, StringHashTableGrower<8ul>, Allocator<true, true>>::HashTable() @ 0x000000001ac1c894
13. /build/src/Common/HashTable/HashMap.h:189: HashMapTable<StringRef, StringHashMapCell<StringRef, char*>, StringHashTableHash, StringHashTableGrower<8ul>, Allocator<true, true>>::HashMapTable() @ 0x000000001ac1c615
14. /build/src/Common/HashTable/StringHashTable.h:272: StringHashTable<StringHashMapSubMaps<char*, Allocator<true, true>>>::StringHashTable() @ 0x000000001ac1c50e
15. /build/src/Common/HashTable/StringHashMap.h:85: StringHashMap<char*, Allocator<true, true>>::StringHashMap() @ 0x000000001ac1c495
16. /build/src/Common/HashTable/TwoLevelStringHashTable.h:44: TwoLevelStringHashTable<StringHashMapSubMaps<char*, Allocator<true, true>>, StringHashMap<char*, Allocator<true, true>>, 8ul>::TwoLevelStringHashTable<StringHashMap<char*, Allocator<true, true>>>(StringHashMap<char*, Allocator<true, true>> const&) @ 0x000000001ac21f1d
17. /build/src/Common/HashTable/TwoLevelStringHashMap.h:15: TwoLevelStringHashMap<char*, Allocator<true, true>, StringHashMap>::TwoLevelStringHashMap<StringHashMap<char*, Allocator<true, true>>>(StringHashMap<char*, Allocator<true, true>> const&) @ 0x000000001ac21e9d
18. /build/src/Interpreters/AggregationMethod.h:115: DB::AggregationMethodStringNoCache<TwoLevelStringHashMap<char*, Allocator<true, true>, StringHashMap>, false>::AggregationMethodStringNoCache<DB::AggregationMethodStringNoCache<StringHashMap<char*, Allocator<true, true>>, false>>(DB::AggregationMethodStringNoCache<StringHashMap<char*, Allocator<true, true>>, false> const&) @ 0x000000001ac21e5d
19. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::AggregationMethodStringNoCache<TwoLevelStringHashMap<char*, Allocator<true, true>, StringHashMap>, false>>::__unique_single std::make_unique[abi:v15000]<DB::AggregationMethodStringNoCache<TwoLevelStringHashMap<char*, Allocator<true, true>, StringHashMap>, false>, DB::AggregationMethodStringNoCache<StringHashMap<char*, Allocator<true, true>>, false>&>(DB::AggregationMethodStringNoCache<StringHashMap<char*, Allocator<true, true>>, false>&) @ 0x000000001ac0cdee
20. /build/src/Interpreters/AggregatedDataVariants.cpp:211: DB::AggregatedDataVariants::convertToTwoLevel() @ 0x000000001ac0518f
21. /build/src/Interpreters/Aggregator.cpp:1642: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x000000001a730a76
22. /build/src/Processors/Transforms/AggregatingTransform.cpp:692: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000001dc97133
23. /build/src/Processors/Transforms/AggregatingTransform.cpp:651: DB::AggregatingTransform::work() @ 0x000000001dc94239
24. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d5329e3
25. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d532720
26. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514ca1
27. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
28. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5

2025.03.05 22:35:35.545189 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:37.903029 [ 5808 ] {7b1d861e-a443-4b22-8fd7-26b8dedb1c65} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=6, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:40866) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:35:37.936374 [ 5808 ] {7b1d861e-a443-4b22-8fd7-26b8dedb1c65} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=6, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:35:38.216055 [ 3923 ] {e89af186-ded4-418c-b541-ae07330c03a6} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=6): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:40850) (comment: 00152_insert_different_granularity.sql) (in query: INSERT INTO fixed_granularity_table SELECT * FROM test.hits LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:35:38.486475 [ 3923 ] {e89af186-ded4-418c-b541-ae07330c03a6} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=6): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:35:42.948318 [ 5809 ] {b6da0b6f-2536-4c36-a118-f931b5db5d68} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=17, jobs=10). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:40918) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:35:42.972902 [ 5809 ] {b6da0b6f-2536-4c36-a118-f931b5db5d68} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=17, jobs=10). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:35:44.152870 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/hgh/msmmwbijzijipwertzdbwkxvoauvp, total size 318767104, count 318767104, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 63639934-cd15-40a0-a27e-e756e267cf0e, upload has finished false.
2025.03.05 22:35:44.154509 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/hgh/msmmwbijzijipwertzdbwkxvoauvp, total size 318767104, count 318767104, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 63639934-cd15-40a0-a27e-e756e267cf0e, upload has finished false
2025.03.05 22:35:44.260031 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/hgh/msmmwbijzijipwertzdbwkxvoauvp, total size 318767104, count 318767104, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 63639934-cd15-40a0-a27e-e756e267cf0e, upload has finished false
2025.03.05 22:35:44.304435 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 67 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:44.694988 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column StartTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_3_3_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6608): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:48.136465 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:48.268488 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:52.428959 [ 3610 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:52.438341 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/gho/bgewbsnfipdcbqgnxknadqjmcuhkj, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 40e35f7b-87f6-480c-a229-6bf97e731083, upload has finished false.
2025.03.05 22:35:52.441358 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/gho/bgewbsnfipdcbqgnxknadqjmcuhkj, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 40e35f7b-87f6-480c-a229-6bf97e731083, upload has finished false
2025.03.05 22:35:52.496379 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/gho/bgewbsnfipdcbqgnxknadqjmcuhkj, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 40e35f7b-87f6-480c-a229-6bf97e731083, upload has finished false
2025.03.05 22:35:52.565115 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 17 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:54.641686 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=1): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:56.412643 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:35:56.424869 [ 5724 ] {6c53156e-db50-4b85-841d-cbc836e19402} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37216) (comment: 00516_deduplication_after_drop_partition_zookeeper.sql) (in query: INSERT INTO deduplication_by_partition VALUES ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:320: DB::ReplicatedMergeTreeSinkImpl<false>::consume(DB::Chunk) @ 0x000000001d0a2220
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975

2025.03.05 22:35:56.440162 [ 5724 ] {6c53156e-db50-4b85-841d-cbc836e19402} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:320: DB::ReplicatedMergeTreeSinkImpl<false>::consume(DB::Chunk) @ 0x000000001d0a2220
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975

2025.03.05 22:35:56.505939 [ 3550 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fe5b5b83-eea3-482d-90c9-5c8d7754068a::202503_1_61_12}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:00.433215 [ 5819 ] {edcf3091-d894-4abc-b990-ad32a4d23638} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54136) (comment: 01611_string_to_low_cardinality_key_alter.sql) (in query: INSERT INTO table_with_lc_key VALUES), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6

2025.03.05 22:36:00.446197 [ 5819 ] {edcf3091-d894-4abc-b990-ad32a4d23638} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6

2025.03.05 22:36:01.104834 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fe5b5b83-eea3-482d-90c9-5c8d7754068a::202503_1_61_12}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:01.559803 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:02.051268 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:02.929624 [ 4789 ] {8fa16034-a6b3-4692-a8ec-cd0d51e07151} <Error> executeQuery: Code: 36. DB::Exception: dateTrunc doesn't support nanosecond: In scope SELECT dateTrunc('Nanosecond', toDate('2022-03-01')). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:54166) (comment: 02935_date_trunc_case_unsensitiveness.sql) (in query: SELECT dateTrunc('Nanosecond', toDate('2022-03-01'));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String&>::type>, String&&, String&) @ 0x000000000cf38e0c
6. /build/src/Functions/date_trunc.cpp:61: DB::(anonymous namespace)::FunctionDateTrunc::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const::'lambda'()::operator()() const @ 0x000000000cf46e28
7. /build/src/Functions/date_trunc.cpp:96: DB::(anonymous namespace)::FunctionDateTrunc::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000cf465d5
8. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000af68950
9. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000190641e7
10. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
11. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
19. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
22. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
30. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
31. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0

2025.03.05 22:36:02.938694 [ 4789 ] {8fa16034-a6b3-4692-a8ec-cd0d51e07151} <Error> TCPHandler: Code: 36. DB::Exception: dateTrunc doesn't support nanosecond: In scope SELECT dateTrunc('Nanosecond', toDate('2022-03-01')). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String&>::type>, String&&, String&) @ 0x000000000cf38e0c
6. /build/src/Functions/date_trunc.cpp:61: DB::(anonymous namespace)::FunctionDateTrunc::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const::'lambda'()::operator()() const @ 0x000000000cf46e28
7. /build/src/Functions/date_trunc.cpp:96: DB::(anonymous namespace)::FunctionDateTrunc::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000cf465d5
8. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000af68950
9. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000190641e7
10. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
11. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
19. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
22. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
30. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
31. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0

2025.03.05 22:36:03.141073 [ 4789 ] {e7561ed6-6892-4364-8478-1e18f7c6c855} <Error> executeQuery: Code: 36. DB::Exception: dateTrunc doesn't support microsecond: In scope SELECT dateTrunc('MicroSecond', toDate('2022-03-01')). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:54166) (comment: 02935_date_trunc_case_unsensitiveness.sql) (in query: SELECT dateTrunc('MicroSecond', toDate('2022-03-01'));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String&>::type>, String&&, String&) @ 0x000000000cf38e0c
6. /build/src/Functions/date_trunc.cpp:61: DB::(anonymous namespace)::FunctionDateTrunc::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const::'lambda'()::operator()() const @ 0x000000000cf46e28
7. /build/src/Functions/date_trunc.cpp:96: DB::(anonymous namespace)::FunctionDateTrunc::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000cf465d5
8. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000af68950
9. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000190641e7
10. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
11. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
19. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
22. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
30. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
31. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0

2025.03.05 22:36:03.178277 [ 4789 ] {e7561ed6-6892-4364-8478-1e18f7c6c855} <Error> TCPHandler: Code: 36. DB::Exception: dateTrunc doesn't support microsecond: In scope SELECT dateTrunc('MicroSecond', toDate('2022-03-01')). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String&>::type>, String&&, String&) @ 0x000000000cf38e0c
6. /build/src/Functions/date_trunc.cpp:61: DB::(anonymous namespace)::FunctionDateTrunc::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const::'lambda'()::operator()() const @ 0x000000000cf46e28
7. /build/src/Functions/date_trunc.cpp:96: DB::(anonymous namespace)::FunctionDateTrunc::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000cf465d5
8. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000af68950
9. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000190641e7
10. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
11. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
19. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
22. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
30. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
31. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0

2025.03.05 22:36:03.317830 [ 4789 ] {46c31426-9090-4f8a-b209-2d58d617b954} <Error> executeQuery: Code: 36. DB::Exception: dateTrunc doesn't support millisecond: In scope SELECT dateTrunc('MILLISECOND', toDate('2022-03-01')). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:54166) (comment: 02935_date_trunc_case_unsensitiveness.sql) (in query: SELECT dateTrunc('MILLISECOND', toDate('2022-03-01'));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String&>::type>, String&&, String&) @ 0x000000000cf38e0c
6. /build/src/Functions/date_trunc.cpp:61: DB::(anonymous namespace)::FunctionDateTrunc::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const::'lambda'()::operator()() const @ 0x000000000cf46e28
7. /build/src/Functions/date_trunc.cpp:96: DB::(anonymous namespace)::FunctionDateTrunc::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000cf465d5
8. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000af68950
9. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000190641e7
10. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
11. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
19. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
22. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
30. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
31. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0

2025.03.05 22:36:03.354883 [ 4789 ] {46c31426-9090-4f8a-b209-2d58d617b954} <Error> TCPHandler: Code: 36. DB::Exception: dateTrunc doesn't support millisecond: In scope SELECT dateTrunc('MILLISECOND', toDate('2022-03-01')). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String&>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String&>::type>, String&&, String&) @ 0x000000000cf38e0c
6. /build/src/Functions/date_trunc.cpp:61: DB::(anonymous namespace)::FunctionDateTrunc::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const::'lambda'()::operator()() const @ 0x000000000cf46e28
7. /build/src/Functions/date_trunc.cpp:96: DB::(anonymous namespace)::FunctionDateTrunc::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000cf465d5
8. /build/src/Functions/IFunctionAdaptors.h:136: DB::FunctionToOverloadResolverAdaptor::getReturnTypeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x000000000af68950
9. /build/src/Functions/IFunction.cpp:522: DB::IFunctionOverloadResolver::getReturnTypeWithoutLowCardinality(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x00000000190641e7
10. /build/src/Functions/IFunction.cpp:468: DB::IFunctionOverloadResolver::getReturnType(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019063c36
11. /build/src/Functions/IFunction.cpp:483: DB::IFunctionOverloadResolver::build(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&) const @ 0x0000000019064241
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6160: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc710
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
19. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
20. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
22. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
30. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
31. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0

2025.03.05 22:36:04.037909 [ 4786 ] {51169ead-2d45-4c40-b03e-0c5070487fb4} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 216.26 MiB (attempt to allocate chunk of 1054720 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000132e9d7a
6. /build/src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e7feb
7. /build/src/Common/MemoryTracker.cpp:398: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e8862
8. /build/src/Common/CurrentMemoryTracker.cpp:58: CurrentMemoryTracker::allocImpl(long, bool) @ 0x00000000132554f1
9. /build/src/Common/CurrentMemoryTracker.cpp:90: CurrentMemoryTracker::alloc(long) @ 0x0000000013255701
10. /build/src/Common/Allocator.cpp:114: Allocator<true, true>::alloc(unsigned long, unsigned long) @ 0x0000000013253e26
11. /build/src/Common/HashTable/HashTable.h:522: HashTable<StringRef, StringHashMapCell<StringRef, char*>, StringHashTableHash, StringHashTableGrower<8ul>, Allocator<true, true>>::alloc(StringHashTableGrower<8ul> const&) @ 0x000000001ac1c8d9
12. /build/src/Common/HashTable/HashTable.h:768: HashTable<StringRef, StringHashMapCell<StringRef, char*>, StringHashTableHash, StringHashTableGrower<8ul>, Allocator<true, true>>::HashTable() @ 0x000000001ac1c894
13. /build/src/Common/HashTable/HashMap.h:189: HashMapTable<StringRef, StringHashMapCell<StringRef, char*>, StringHashTableHash, StringHashTableGrower<8ul>, Allocator<true, true>>::HashMapTable() @ 0x000000001ac1c615
14. /build/src/Common/HashTable/StringHashTable.h:272: StringHashTable<StringHashMapSubMaps<char*, Allocator<true, true>>>::StringHashTable() @ 0x000000001ac1c50e
15. /build/src/Common/HashTable/StringHashMap.h:85: StringHashMap<char*, Allocator<true, true>>::StringHashMap() @ 0x000000001ac1c495
16. /build/src/Common/HashTable/TwoLevelStringHashTable.h:44: TwoLevelStringHashTable<StringHashMapSubMaps<char*, Allocator<true, true>>, StringHashMap<char*, Allocator<true, true>>, 8ul>::TwoLevelStringHashTable<StringHashMap<char*, Allocator<true, true>>>(StringHashMap<char*, Allocator<true, true>> const&) @ 0x000000001ac21f1d
17. /build/src/Common/HashTable/TwoLevelStringHashMap.h:15: TwoLevelStringHashMap<char*, Allocator<true, true>, StringHashMap>::TwoLevelStringHashMap<StringHashMap<char*, Allocator<true, true>>>(StringHashMap<char*, Allocator<true, true>> const&) @ 0x000000001ac21e9d
18. /build/src/Interpreters/AggregationMethod.h:115: DB::AggregationMethodStringNoCache<TwoLevelStringHashMap<char*, Allocator<true, true>, StringHashMap>, false>::AggregationMethodStringNoCache<DB::AggregationMethodStringNoCache<StringHashMap<char*, Allocator<true, true>>, false>>(DB::AggregationMethodStringNoCache<StringHashMap<char*, Allocator<true, true>>, false> const&) @ 0x000000001ac21e5d
19. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::AggregationMethodStringNoCache<TwoLevelStringHashMap<char*, Allocator<true, true>, StringHashMap>, false>>::__unique_single std::make_unique[abi:v15000]<DB::AggregationMethodStringNoCache<TwoLevelStringHashMap<char*, Allocator<true, true>, StringHashMap>, false>, DB::AggregationMethodStringNoCache<StringHashMap<char*, Allocator<true, true>>, false>&>(DB::AggregationMethodStringNoCache<StringHashMap<char*, Allocator<true, true>>, false>&) @ 0x000000001ac0cdee
20. /build/src/Interpreters/AggregatedDataVariants.cpp:211: DB::AggregatedDataVariants::convertToTwoLevel() @ 0x000000001ac0518f
21. /build/src/Interpreters/Aggregator.cpp:1642: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x000000001a730a76
22. /build/src/Processors/Transforms/AggregatingTransform.cpp:692: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000001dc97133
23. /build/src/Processors/Transforms/AggregatingTransform.cpp:651: DB::AggregatingTransform::work() @ 0x000000001dc94239
24. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d5329e3
25. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d532720
26. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514ca1
27. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
28. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5

2025.03.05 22:36:05.907718 [ 5809 ] {0b0172ea-aece-410a-b8e1-c4bdac1e8364} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54150) (comment: 00159_parallel_formatting_csv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format CSV), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:36:08.373410 [ 5809 ] {0b0172ea-aece-410a-b8e1-c4bdac1e8364} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:36:11.659425 [ 4789 ] {f160a0cc-ed91-4927-9d73-3da0436351b0} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46380) (comment: 01088_window_view_default_column.sh) (in query: CREATE WINDOW VIEW wv TO dst WATERMARK=ASCENDING AS SELECT count(a) AS count, tumbleEnd(wid) AS w_end FROM mt GROUP BY tumble(timestamp, INTERVAL '5' SECOND, 'US/Samoa') AS wid;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a357647
21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3573b9
22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a927662
23. /build/src/Storages/MergeTree/MergeTreeData.cpp:306: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000001cbacb42
24. /build/src/Storages/StorageMergeTree.cpp:117: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>) @ 0x000000001d0e9fd1
25. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageMergeTree* std::construct_at[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::StorageMergeTree*>(DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e99b7
26. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageMergeTree>>::construct[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void, void>(std::allocator<DB::StorageMergeTree>&, DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e96c7
27. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>>(std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e9375
28. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e91a7
29. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageMergeTree> std::make_shared[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e636d
30. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:741: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e3eaa
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019306cfd

2025.03.05 22:36:11.697686 [ 4789 ] {f160a0cc-ed91-4927-9d73-3da0436351b0} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a357647
21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3573b9
22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a927662
23. /build/src/Storages/MergeTree/MergeTreeData.cpp:306: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000001cbacb42
24. /build/src/Storages/StorageMergeTree.cpp:117: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>) @ 0x000000001d0e9fd1
25. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageMergeTree* std::construct_at[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::StorageMergeTree*>(DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e99b7
26. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageMergeTree>>::construct[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void, void>(std::allocator<DB::StorageMergeTree>&, DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e96c7
27. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>>(std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e9375
28. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e91a7
29. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageMergeTree> std::make_shared[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e636d
30. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:741: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e3eaa
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019306cfd

2025.03.05 22:36:11.871745 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/iqm/audhkrfiqtrdamipwrhmdwrqvsnxb, total size 218103808, count 218103808, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 8a23f1dd-8a81-4070-b65b-41c0f47ba9d2, upload has finished false.
2025.03.05 22:36:11.881631 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/iqm/audhkrfiqtrdamipwrhmdwrqvsnxb, total size 218103808, count 218103808, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 8a23f1dd-8a81-4070-b65b-41c0f47ba9d2, upload has finished false
2025.03.05 22:36:12.028128 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/iqm/audhkrfiqtrdamipwrhmdwrqvsnxb, total size 218103808, count 218103808, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 8a23f1dd-8a81-4070-b65b-41c0f47ba9d2, upload has finished false
2025.03.05 22:36:12.118412 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 48 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:13.320985 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:13.520903 [ 5819 ] {ba53c6b0-c7fc-4796-8dac-805294217d73} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=26): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46358) (comment: 00154_avro.sql) (in query: INSERT INTO test.avro SELECT * FROM test.hits LIMIT 10000;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:36:13.572183 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:13.959956 [ 5819 ] {ba53c6b0-c7fc-4796-8dac-805294217d73} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=26): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:36:17.783369 [ 5809 ] {d6e8e649-8c7a-4f93-9ad8-2c8799a6a292} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46390) (comment: 03164_create_as_default.sql) (in query: INSERT INTO src_table(sipTimestamp) VALUES ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d

2025.03.05 22:36:17.796624 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 6 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:17.797159 [ 5809 ] {d6e8e649-8c7a-4f93-9ad8-2c8799a6a292} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d

2025.03.05 22:36:18.377538 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:18.777768 [ 5808 ] {4724b2c0-767b-4cdb-b457-e4e7c6de20f8} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InReverseOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47032) (comment: 00151_order_by_read_in_order.sql) (in query: SELECT CounterID FROM test.hits ORDER BY CounterID DESC LIMIT 50;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:36:18.864435 [ 5808 ] {4724b2c0-767b-4cdb-b457-e4e7c6de20f8} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InReverseOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:36:20.601041 [ 4786 ] {ea6eca70-b9d3-41cf-8b77-17639c33079f} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=22): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46396) (comment: 00159_parallel_formatting_csv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format CSV), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:36:21.712454 [ 5809 ] {0267e1e4-0346-4241-a539-318c6f5d077e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47066) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:36:21.766773 [ 5809 ] {0267e1e4-0346-4241-a539-318c6f5d077e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:36:22.060426 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 6 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:22.696479 [ 3584 ] {} <Warning> system.trace_log (0d6617f8-564f-43ff-a6dc-a74b9f150261): Removing temporary directory /var/lib/clickhouse/disks/s3/store/0d6/0d6617f8-564f-43ff-a6dc-a74b9f150261/tmp_merge_202503_1_68_13/
2025.03.05 22:36:22.699200 [ 3584 ] {} <Warning> system.trace_log (0d6617f8-564f-43ff-a6dc-a74b9f150261): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/0d6/0d6617f8-564f-43ff-a6dc-a74b9f150261/tmp_merge_202503_1_68_13/
2025.03.05 22:36:22.995851 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {0d6617f8-564f-43ff-a6dc-a74b9f150261::202503_1_68_13}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column ptr): (while reading from part /var/lib/clickhouse/disks/s3/store/0d6/0d6617f8-564f-43ff-a6dc-a74b9f150261/202503_1_62_12/ in table system.trace_log (0d6617f8-564f-43ff-a6dc-a74b9f150261) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/SerializationSparse.cpp:165: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x000000001a051489
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:23.380152 [ 3550 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_1_100_18}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:45: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce470d
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:23.817125 [ 4786 ] {ea6eca70-b9d3-41cf-8b77-17639c33079f} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=22): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:36:24.798179 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:25.258927 [ 5809 ] {7fd929fa-c192-4a31-ba0c-981b3fc9a9b6} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=10). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34242) (comment: 00141_transform.sql) (in query: SELECT transform(SearchEngineID, [2, 3], ['Яндекс', 'Google'], 'Остальные') AS title, count() AS c FROM test.hits WHERE SearchEngineID != 0 GROUP BY title HAVING c > 0 ORDER BY c DESC LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:36:25.550029 [ 5809 ] {7fd929fa-c192-4a31-ba0c-981b3fc9a9b6} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=10). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:36:26.718365 [ 5808 ] {36001b3b-3172-4899-9745-519d7c559e6e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34274) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:36:26.749415 [ 5808 ] {36001b3b-3172-4899-9745-519d7c559e6e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:36:28.541436 [ 3581 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Removing temporary directory /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:36:28.542136 [ 3581 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:36:28.680875 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/bte/tkhaslucofrccxuvjsbaiheonfwea, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 51cd2f97-db3a-4b47-958e-02fae0e94781, upload has finished false.
2025.03.05 22:36:28.681888 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/bte/tkhaslucofrccxuvjsbaiheonfwea, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 51cd2f97-db3a-4b47-958e-02fae0e94781, upload has finished false
2025.03.05 22:36:28.725625 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/bte/tkhaslucofrccxuvjsbaiheonfwea, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 51cd2f97-db3a-4b47-958e-02fae0e94781, upload has finished false
2025.03.05 22:36:28.829502 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 14 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:30.631650 [ 3923 ] {499e05ec-c8d4-4bcc-8a7c-134013d504a5} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34300) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:36:30.677380 [ 3923 ] {499e05ec-c8d4-4bcc-8a7c-134013d504a5} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:36:31.521530 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:32.630104 [ 5809 ] {61f1a601-693d-4510-8a3e-83414e515fa7} <Error> executeQuery: Code: 80. DB::Exception: Cannot CREATE a table AS test_fydvai5u.mv_from_base_to_target, it is a Materialized View without storage. Use "AS `test_fydvai5u.target_table`" instead. (INCORRECT_QUERY) (version 24.3.12.76.altinitystable) (from [::1]:34288) (comment: 03161_create_table_as_mv.sql) (in query: CREATE TABLE other_table_2 AS mv_from_base_to_target;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, DB::QualifiedTableName>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<DB::QualifiedTableName>::type>, String const&, DB::QualifiedTableName&&) @ 0x000000001b021e8c
6. /build/src/Interpreters/InterpreterCreateQuery.cpp:982: DB::InterpreterCreateQuery::setEngine(DB::ASTCreateQuery&) const @ 0x000000001b010bce
7. /build/src/Interpreters/InterpreterCreateQuery.cpp:723: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x000000001b00de7c
8. /build/src/Interpreters/InterpreterCreateQuery.cpp:1221: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b015bc4
9. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe96
10. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
11. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
12. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
13. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
19. ? @ 0x00007f7a996d8ac3
20. ? @ 0x00007f7a9976a850

2025.03.05 22:36:32.641639 [ 5809 ] {61f1a601-693d-4510-8a3e-83414e515fa7} <Error> TCPHandler: Code: 80. DB::Exception: Cannot CREATE a table AS test_fydvai5u.mv_from_base_to_target, it is a Materialized View without storage. Use "AS `test_fydvai5u.target_table`" instead. (INCORRECT_QUERY), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, DB::QualifiedTableName>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<DB::QualifiedTableName>::type>, String const&, DB::QualifiedTableName&&) @ 0x000000001b021e8c
6. /build/src/Interpreters/InterpreterCreateQuery.cpp:982: DB::InterpreterCreateQuery::setEngine(DB::ASTCreateQuery&) const @ 0x000000001b010bce
7. /build/src/Interpreters/InterpreterCreateQuery.cpp:723: DB::InterpreterCreateQuery::getTablePropertiesAndNormalizeCreateQuery(DB::ASTCreateQuery&) const @ 0x000000001b00de7c
8. /build/src/Interpreters/InterpreterCreateQuery.cpp:1221: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b015bc4
9. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe96
10. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
11. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
12. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
13. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
14. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
15. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
16. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
17. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
18. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
19. ? @ 0x00007f7a996d8ac3
20. ? @ 0x00007f7a9976a850

2025.03.05 22:36:33.095346 [ 5808 ] {b757ab8f-6ac7-4c99-8ba3-eb7f97d6fb03} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34280) (comment: 00159_parallel_formatting_csv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format CSVWithNames), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:36:34.089411 [ 5808 ] {b757ab8f-6ac7-4c99-8ba3-eb7f97d6fb03} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:36:35.888781 [ 5819 ] {0aa93717-3cfe-4351-afb7-6923bf86e527} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47052) (comment: 00926_adaptive_index_granularity_pk.sql) (in query: SELECT count() FROM merge_tree WHERE toUInt32(x) IN (0, 0);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:36:35.894090 [ 5819 ] {0aa93717-3cfe-4351-afb7-6923bf86e527} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:36:36.985090 [ 3780 ] {c0d5885d-2172-40a6-9702-9e6c88479c2e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=27, jobs=27). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43034) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:36:37.048031 [ 3780 ] {c0d5885d-2172-40a6-9702-9e6c88479c2e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=27, jobs=27). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:36:37.542052 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column UTCStartTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_2_2_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6592): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:37.629469 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/gav/qeccbjaunnivxpqlgctsdmbxjjzsd, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 3247d939-2879-4409-a4c4-91438de2bf38, upload has finished false.
2025.03.05 22:36:37.638494 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/gav/qeccbjaunnivxpqlgctsdmbxjjzsd, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 3247d939-2879-4409-a4c4-91438de2bf38, upload has finished false
2025.03.05 22:36:37.701579 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/gav/qeccbjaunnivxpqlgctsdmbxjjzsd, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 3247d939-2879-4409-a4c4-91438de2bf38, upload has finished false
2025.03.05 22:36:37.810945 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 26 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:40.556846 [ 3923 ] {31408668-bdd2-45a8-bd8a-a2b5eaccb6b1} <Error> executeQuery: Code: 215. DB::Exception: Column mn is not under aggregate function and not in GROUP BY keys. In query SELECT n, number + 5 AS inter FROM (SELECT toFloat32(number % 10) AS n, number, number * 2 AS mn FROM numbers(10) WHERE (number % 3) = 1) GROUP BY n, inter ORDER BY n ASC WITH FILL FROM 0 TO 5.51 STEP 0.5 INTERPOLATE ( inter AS mn * 2 ). (NOT_AN_AGGREGATE) (version 24.3.12.76.altinitystable) (from [::1]:43048) (comment: 03155_analyzer_interpolate.sql) (in query: SELECT n, number+5 AS inter FROM ( -- { serverError NOT_AN_AGGREGATE }
 SELECT toFloat32(number % 10) AS n, number, number*2 AS mn FROM numbers(10) WHERE number % 3 = 1 ) GROUP BY n, inter ORDER BY n WITH FILL FROM 0 TO 5.51 STEP 0.5 INTERPOLATE (inter AS mn * 2);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Analyzer/ValidationUtils.cpp:118: DB::(anonymous namespace)::ValidateGroupByColumnsVisitor::visitImpl(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b13878b
7. /build/src/Analyzer/InDepthQueryTreeVisitor.h:66: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visit(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b137a36
8. /build/src/Analyzer/InDepthQueryTreeVisitor.h:83: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visitChildren(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b1382a2
9. /build/src/Analyzer/InDepthQueryTreeVisitor.h:68: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visit(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b137a53
10. /build/src/Analyzer/InDepthQueryTreeVisitor.h:83: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visitChildren(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b1382a2
11. /build/src/Analyzer/InDepthQueryTreeVisitor.h:68: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visit(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b137a53
12. /build/src/Analyzer/InDepthQueryTreeVisitor.h:83: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visitChildren(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b1382a2
13. /build/src/Analyzer/InDepthQueryTreeVisitor.h:68: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visit(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b137a53
14. /build/src/Analyzer/InDepthQueryTreeVisitor.h:83: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visitChildren(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b1382a2
15. /build/src/Analyzer/InDepthQueryTreeVisitor.h:68: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visit(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b137a53
16. /build/src/Analyzer/ValidationUtils.cpp:270: DB::validateAggregates(std::shared_ptr<DB::IQueryTreeNode> const&, DB::AggregatesValidationParams) @ 0x000000001b137779
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8330: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09d227
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
20. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
23. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
31. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d

2025.03.05 22:36:40.557491 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:40.591259 [ 3923 ] {31408668-bdd2-45a8-bd8a-a2b5eaccb6b1} <Error> TCPHandler: Code: 215. DB::Exception: Column mn is not under aggregate function and not in GROUP BY keys. In query SELECT n, number + 5 AS inter FROM (SELECT toFloat32(number % 10) AS n, number, number * 2 AS mn FROM numbers(10) WHERE (number % 3) = 1) GROUP BY n, inter ORDER BY n ASC WITH FILL FROM 0 TO 5.51 STEP 0.5 INTERPOLATE ( inter AS mn * 2 ). (NOT_AN_AGGREGATE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Analyzer/ValidationUtils.cpp:118: DB::(anonymous namespace)::ValidateGroupByColumnsVisitor::visitImpl(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b13878b
7. /build/src/Analyzer/InDepthQueryTreeVisitor.h:66: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visit(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b137a36
8. /build/src/Analyzer/InDepthQueryTreeVisitor.h:83: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visitChildren(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b1382a2
9. /build/src/Analyzer/InDepthQueryTreeVisitor.h:68: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visit(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b137a53
10. /build/src/Analyzer/InDepthQueryTreeVisitor.h:83: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visitChildren(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b1382a2
11. /build/src/Analyzer/InDepthQueryTreeVisitor.h:68: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visit(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b137a53
12. /build/src/Analyzer/InDepthQueryTreeVisitor.h:83: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visitChildren(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b1382a2
13. /build/src/Analyzer/InDepthQueryTreeVisitor.h:68: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visit(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b137a53
14. /build/src/Analyzer/InDepthQueryTreeVisitor.h:83: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visitChildren(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b1382a2
15. /build/src/Analyzer/InDepthQueryTreeVisitor.h:68: DB::InDepthQueryTreeVisitor<DB::(anonymous namespace)::ValidateGroupByColumnsVisitor, true>::visit(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001b137a53
16. /build/src/Analyzer/ValidationUtils.cpp:270: DB::validateAggregates(std::shared_ptr<DB::IQueryTreeNode> const&, DB::AggregatesValidationParams) @ 0x000000001b137779
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8330: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09d227
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
20. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
23. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
31. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d

2025.03.05 22:36:40.902733 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_1_1_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 1 with max_rows_to_read = 6658): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:42.571652 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:43.259931 [ 3780 ] {32d72190-60b1-47a4-91de-20e0e95db136} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=15): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43050) (comment: 00159_parallel_formatting_csv_and_friends.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a, MobilePhoneModel as b, ClientIP6 as c FROM test.hits ORDER BY a, b, c Format CSVWithNames), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:36:44.907077 [ 4786 ] {7e8fd532-e3a2-4cf4-9006-b6d95642550f} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=18): (while reading column StartDate): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_1_1_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 8 with max_rows_to_read = 53264): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34294) (comment: 00042_any_left_join.sql) (in query: SELECT EventDate, hits, visits FROM ( SELECT EventDate, count() AS hits FROM test.hits GROUP BY EventDate ) ANY LEFT JOIN ( SELECT StartDate AS EventDate, sum(Sign) AS visits FROM test.visits GROUP BY EventDate ) USING EventDate ORDER BY hits DESC LIMIT 10 SETTINGS joined_subquery_requires_alias = 0;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710

2025.03.05 22:36:45.515821 [ 3780 ] {32d72190-60b1-47a4-91de-20e0e95db136} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=15): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:36:46.217075 [ 5724 ] {23b030af-7414-440d-9251-407af4a41a41} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55916) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:36:46.252655 [ 5724 ] {23b030af-7414-440d-9251-407af4a41a41} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:36:47.225200 [ 3780 ] {13e1295a-32d1-4deb-9c11-87146721155f} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=40, jobs=40). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55928) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:36:47.276445 [ 3780 ] {13e1295a-32d1-4deb-9c11-87146721155f} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=40, jobs=40). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:36:47.859207 [ 4786 ] {7e8fd532-e3a2-4cf4-9006-b6d95642550f} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=18): (while reading column StartDate): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_1_1_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 8 with max_rows_to_read = 53264): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710

2025.03.05 22:36:51.434135 [ 3780 ] {4a36883f-92d0-4476-b162-a8c337e3a538} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55956) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:36:51.503268 [ 3780 ] {4a36883f-92d0-4476-b162-a8c337e3a538} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:36:52.996736 [ 3780 ] {0afa9913-d06b-417c-a2d3-77f13cc59a3e} <Error> executeQuery: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST) (version 24.3.12.76.altinitystable) (from [::1]:55988) (in query: select _path,_file from file('nonexist.txt', 'CSV', 'val1 char')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a941e33
6. /build/src/Storages/StorageFile.cpp:1573: DB::StorageFile::read(DB::QueryPlan&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000001c37976d
7. /build/src/Planner/PlannerJoinTree.cpp:878: DB::(anonymous namespace)::buildQueryPlanForTableExpression(std::shared_ptr<DB::IQueryTreeNode>, DB::SelectQueryInfo const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::PlannerContext>&, bool, bool) @ 0x000000001b551e18
8. /build/src/Planner/PlannerJoinTree.cpp:1667: DB::buildJoinTreeQueryPlan(std::shared_ptr<DB::IQueryTreeNode> const&, DB::SelectQueryInfo const&, DB::SelectQueryOptions&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&, std::shared_ptr<DB::PlannerContext>&) @ 0x000000001b54d510
9. /build/src/Planner/Planner.cpp:1473: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50e306
10. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50a455
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50765d
12. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0e12
13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
21. ? @ 0x00007f7a996d8ac3
22. ? @ 0x00007f7a9976a850

2025.03.05 22:36:53.019777 [ 3780 ] {0afa9913-d06b-417c-a2d3-77f13cc59a3e} <Error> TCPHandler: Code: 107. DB::Exception: File /var/lib/clickhouse/user_files/nonexist.txt doesn't exist. (FILE_DOESNT_EXIST), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a941e33
6. /build/src/Storages/StorageFile.cpp:1573: DB::StorageFile::read(DB::QueryPlan&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::SelectQueryInfo&, std::shared_ptr<DB::Context const>, DB::QueryProcessingStage::Enum, unsigned long, unsigned long) @ 0x000000001c37976d
7. /build/src/Planner/PlannerJoinTree.cpp:878: DB::(anonymous namespace)::buildQueryPlanForTableExpression(std::shared_ptr<DB::IQueryTreeNode>, DB::SelectQueryInfo const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::PlannerContext>&, bool, bool) @ 0x000000001b551e18
8. /build/src/Planner/PlannerJoinTree.cpp:1667: DB::buildJoinTreeQueryPlan(std::shared_ptr<DB::IQueryTreeNode> const&, DB::SelectQueryInfo const&, DB::SelectQueryOptions&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&, std::shared_ptr<DB::PlannerContext>&) @ 0x000000001b54d510
9. /build/src/Planner/Planner.cpp:1473: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50e306
10. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50a455
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50765d
12. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0e12
13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
21. ? @ 0x00007f7a996d8ac3
22. ? @ 0x00007f7a9976a850

2025.03.05 22:36:53.682845 [ 4786 ] {a1765c80-8947-423a-b772-10f07905575b} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55946) (comment: 00005_filtering.sql) (in query: SELECT count() FROM test.hits WHERE AdvEngineID != 0 ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:36:53.684045 [ 3923 ] {dabbb365-6e4f-407f-bd2b-eca5cd9a2fee} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55932) (comment: 03155_in_nested_subselects.sql) (in query: select * from Example;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeReadTask.cpp:44: DB::MergeTreeReadTask::createReaders(std::shared_ptr<DB::MergeTreeReadTaskInfo const> const&, DB::MergeTreeReadTask::Extras const&, DB::MarkRanges const&)::$_0::operator()(DB::NamesAndTypesList const&) const @ 0x000000001ce975a7
29. /build/src/Storages/MergeTree/MergeTreeReadTask.cpp:57: DB::MergeTreeReadTask::createReaders(std::shared_ptr<DB::MergeTreeReadTaskInfo const> const&, DB::MergeTreeReadTask::Extras const&, DB::MarkRanges const&) @ 0x000000001ce970c6
30. /build/src/Storages/MergeTree/MergeTreeReadPoolBase.cpp:160: DB::MergeTreeReadPoolBase::createTask(std::shared_ptr<DB::MergeTreeReadTaskInfo const>, DB::MarkRanges, DB::MergeTreeReadTask*) const @ 0x000000001dda94ea
31. /build/src/Storages/MergeTree/MergeTreeReadPool.cpp:177: DB::MergeTreeReadPool::getTask(unsigned long, DB::MergeTreeReadTask*) @ 0x000000001dddc452

2025.03.05 22:36:53.877692 [ 3923 ] {dabbb365-6e4f-407f-bd2b-eca5cd9a2fee} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeReadTask.cpp:44: DB::MergeTreeReadTask::createReaders(std::shared_ptr<DB::MergeTreeReadTaskInfo const> const&, DB::MergeTreeReadTask::Extras const&, DB::MarkRanges const&)::$_0::operator()(DB::NamesAndTypesList const&) const @ 0x000000001ce975a7
29. /build/src/Storages/MergeTree/MergeTreeReadTask.cpp:57: DB::MergeTreeReadTask::createReaders(std::shared_ptr<DB::MergeTreeReadTaskInfo const> const&, DB::MergeTreeReadTask::Extras const&, DB::MarkRanges const&) @ 0x000000001ce970c6
30. /build/src/Storages/MergeTree/MergeTreeReadPoolBase.cpp:160: DB::MergeTreeReadPoolBase::createTask(std::shared_ptr<DB::MergeTreeReadTaskInfo const>, DB::MarkRanges, DB::MergeTreeReadTask*) const @ 0x000000001dda94ea
31. /build/src/Storages/MergeTree/MergeTreeReadPool.cpp:177: DB::MergeTreeReadPool::getTask(unsigned long, DB::MergeTreeReadTask*) @ 0x000000001dddc452

2025.03.05 22:36:54.290052 [ 4786 ] {a1765c80-8947-423a-b772-10f07905575b} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:36:54.656054 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {6cd90e1d-0955-4f5f-a660-a94482f8afc2::202503_1_56_11}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:36:56.263285 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_1_106_18}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=10). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:02.565984 [ 5724 ] {b5ee8d33-1f89-41b8-bdfb-f7bf45883c0b} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:40218) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:02.602946 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/dkh/vkoqtunxnbfhmdwpnkizrkiimysqp, total size 318767104, count 318767104, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id ffb91d54-7023-4e35-9264-cfaa1ecd2df7, upload has finished false.
2025.03.05 22:37:02.604179 [ 5724 ] {b5ee8d33-1f89-41b8-bdfb-f7bf45883c0b} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:02.604844 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/dkh/vkoqtunxnbfhmdwpnkizrkiimysqp, total size 318767104, count 318767104, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id ffb91d54-7023-4e35-9264-cfaa1ecd2df7, upload has finished false
2025.03.05 22:37:02.746299 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/dkh/vkoqtunxnbfhmdwpnkizrkiimysqp, total size 318767104, count 318767104, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id ffb91d54-7023-4e35-9264-cfaa1ecd2df7, upload has finished false
2025.03.05 22:37:02.786152 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:567: DB::WriteBufferFromS3::writePart(DB::WriteBufferFromS3::PartData&&) @ 0x000000001991336e
18. /build/src/IO/WriteBufferFromS3.cpp:370: DB::WriteBufferFromS3::writeMultipartUpload() @ 0x00000000199074b6
19. /build/src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::nextImpl() @ 0x0000000019906b7e
20. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
21. /build/src/IO/WriteBufferFromFileDecorator.cpp:71: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x000000001a3579ad
22. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
23. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
24. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
25. /build/src/IO/WriteBuffer.h:76: DB::WriteBuffer::nextIfAtEnd() @ 0x000000000a92ff78
26. /build/src/IO/WriteBuffer.h:91: DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000a92fde0
27. /build/src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x0000000019ddbded
28. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
29. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
30. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
31. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:350: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ccf3e39
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:03.060735 [ 5808 ] {c64d574b-9ebd-42f3-80bd-051f34b7783a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:40222) (comment: 02246_tsv_csv_best_effort_schema_inference.sh) (in query: select * from file('test_02149.data', 'TSV')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:03.127316 [ 5808 ] {c64d574b-9ebd-42f3-80bd-051f34b7783a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:04.251101 [ 5724 ] {5547db30-76c3-48c2-95e8-974d8f1e3a64} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50176) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:04.267458 [ 3780 ] {3695b935-7013-4c41-b79a-59ab5148b16f} <Error> executeQuery: Code: 47. DB::Exception: Unknown identifier 'xyz' inside COLUMNS matcher. In scope Scope node SELECT COLUMNS(bar, foo, xyz) APPLY length FROM test
Identifier lookup to resolve state 2
Identifier foo EXPRESSION resolve result test_8xm3d2gn.test.foo place JOIN_TREE resolved from parent scopes 0
Identifier bar EXPRESSION resolve result test_8xm3d2gn.test.bar place JOIN_TREE resolved from parent scopes 0
Expression argument name to node 0
Alias name to expression node table size 0
Alias name to function node table size 0
Alias name to table expression node table size 0
CTE name to query node table size 0
WINDOW name to window node table size 0
Nodes with duplicated aliases size 0
Expression resolve process stack 
1
Expression COLUMNS(bar, foo, xyz) APPLY length
Table expressions in resolve process size 0
Non cached identifier lookups during expression resolve 0
Table expression node to data 1
Table expression node test_8xm3d2gn.test data Table expression name test_8xm3d2gn.test table expression description table database name test_8xm3d2gn table name test should qualify columns 1 columns size 10
Column name _block_number column node COLUMN id: 0, column_name: _block_number, result_type: UInt64, source_id: 1
Column name _row_exists column node COLUMN id: 0, column_name: _row_exists, result_type: UInt8, source_id: 1
Column name _part_offset column node COLUMN id: 0, column_name: _part_offset, result_type: UInt64, source_id: 1
Column name _sample_factor column node COLUMN id: 0, column_name: _sample_factor, result_type: Float64, source_id: 1
Column name _part_uuid column node COLUMN id: 0, column_name: _part_uuid, result_type: UUID, source_id: 1
Column name _partition_id column node COLUMN id: 0, column_name: _partition_id, result_type: LowCardinality(String), source_id: 1
Column name _part column node COLUMN id: 0, column_name: _part, result_type: LowCardinality(String), source_id: 1
Column name bar column node COLUMN id: 0, column_name: bar, result_type: String, source_id: 1
Column name _part_index column node COLUMN id: 0, column_name: _part_index, result_type: UInt64, source_id: 1
Column name foo column node COLUMN id: 0, column_name: foo, result_type: String, source_id: 1

Use identifier lookup to result cache 1
Subquery depth 0
. (UNKNOWN_IDENTIFIER) (version 24.3.12.76.altinitystable) (from [::1]:40206) (comment: 03152_analyzer_columns_list.sql) (in query: SELECT COLUMNS(bar, foo, xyz) APPLY (length) FROM test;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:4629: DB::(anonymous namespace)::QueryAnalyzer::resolveUnqualifiedMatcher(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0dd71d
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:4840: DB::(anonymous namespace)::QueryAnalyzer::resolveMatcher(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0da0c0
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6450: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a1120
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
14. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
15. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
16. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
17. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
25. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
26. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
27. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
28. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
29. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
30. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
31. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528

2025.03.05 22:37:04.274886 [ 5724 ] {5547db30-76c3-48c2-95e8-974d8f1e3a64} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:04.337066 [ 3780 ] {3695b935-7013-4c41-b79a-59ab5148b16f} <Error> TCPHandler: Code: 47. DB::Exception: Unknown identifier 'xyz' inside COLUMNS matcher. In scope Scope node SELECT COLUMNS(bar, foo, xyz) APPLY length FROM test
Identifier lookup to resolve state 2
Identifier foo EXPRESSION resolve result test_8xm3d2gn.test.foo place JOIN_TREE resolved from parent scopes 0
Identifier bar EXPRESSION resolve result test_8xm3d2gn.test.bar place JOIN_TREE resolved from parent scopes 0
Expression argument name to node 0
Alias name to expression node table size 0
Alias name to function node table size 0
Alias name to table expression node table size 0
CTE name to query node table size 0
WINDOW name to window node table size 0
Nodes with duplicated aliases size 0
Expression resolve process stack 
1
Expression COLUMNS(bar, foo, xyz) APPLY length
Table expressions in resolve process size 0
Non cached identifier lookups during expression resolve 0
Table expression node to data 1
Table expression node test_8xm3d2gn.test data Table expression name test_8xm3d2gn.test table expression description table database name test_8xm3d2gn table name test should qualify columns 1 columns size 10
Column name _block_number column node COLUMN id: 0, column_name: _block_number, result_type: UInt64, source_id: 1
Column name _row_exists column node COLUMN id: 0, column_name: _row_exists, result_type: UInt8, source_id: 1
Column name _part_offset column node COLUMN id: 0, column_name: _part_offset, result_type: UInt64, source_id: 1
Column name _sample_factor column node COLUMN id: 0, column_name: _sample_factor, result_type: Float64, source_id: 1
Column name _part_uuid column node COLUMN id: 0, column_name: _part_uuid, result_type: UUID, source_id: 1
Column name _partition_id column node COLUMN id: 0, column_name: _partition_id, result_type: LowCardinality(String), source_id: 1
Column name _part column node COLUMN id: 0, column_name: _part, result_type: LowCardinality(String), source_id: 1
Column name bar column node COLUMN id: 0, column_name: bar, result_type: String, source_id: 1
Column name _part_index column node COLUMN id: 0, column_name: _part_index, result_type: UInt64, source_id: 1
Column name foo column node COLUMN id: 0, column_name: foo, result_type: String, source_id: 1

Use identifier lookup to result cache 1
Subquery depth 0
. (UNKNOWN_IDENTIFIER), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:4629: DB::(anonymous namespace)::QueryAnalyzer::resolveUnqualifiedMatcher(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0dd71d
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:4840: DB::(anonymous namespace)::QueryAnalyzer::resolveMatcher(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0da0c0
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6450: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a1120
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
10. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
11. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
12. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
13. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
14. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
15. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
16. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
17. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
20. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
25. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
26. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
27. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
28. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
29. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
30. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
31. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528

2025.03.05 22:37:05.795594 [ 3614 ] {} <Error> void DB::SystemLog<DB::SessionLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:06.999326 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:07.661515 [ 5724 ] {573e1abd-8338-4b9e-aa2d-c58347266681} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=21, jobs=11). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50178) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:07.700047 [ 5724 ] {573e1abd-8338-4b9e-aa2d-c58347266681} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=21, jobs=11). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:09.001969 [ 3585 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Removing temporary directory /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:37:09.002550 [ 3585 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:37:09.324405 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 12 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:14.494958 [ 3780 ] {c2731dca-7df0-4ad0-a5f5-7652c41aafa1} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=32, jobs=32). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53524) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:14.554095 [ 3780 ] {c2731dca-7df0-4ad0-a5f5-7652c41aafa1} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=32, jobs=32). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:15.606053 [ 5808 ] {e9b3404c-1d22-4cda-ab48-b2eff60f34bb} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=47): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50208) (comment: 00157_cache_dictionary.sql) (in query: INSERT INTO test.hits_1m SELECT * FROM test.hits LIMIT 1000000;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:37:16.152460 [ 5808 ] {e9b3404c-1d22-4cda-ab48-b2eff60f34bb} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=47): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:37:17.797299 [ 3780 ] {4761e235-7659-43a7-8750-de1b38576151} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=43, jobs=43). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53564) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:37:17.870216 [ 3780 ] {4761e235-7659-43a7-8750-de1b38576151} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=43, jobs=43). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:37:19.018555 [ 3633 ] {} <Error> void DB::SystemLog<DB::TraceLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:19.309950 [ 3780 ] {dc3bd46f-b840-44f1-842a-f910f5562753} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53580) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:37:19.355715 [ 3780 ] {dc3bd46f-b840-44f1-842a-f910f5562753} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:37:21.746510 [ 3923 ] {2df13e39-c362-484c-81e1-e16bef5e7d06} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:40202) (comment: 00165_jit_aggregate_functions.sql) (in query: WITH (WatchID % 2 == 0) AS predicate SELECT CounterID, minIf(WatchID,predicate), maxIf(WatchID, predicate), sumIf(WatchID, predicate), avgIf(WatchID, predicate), avgWeightedIf(WatchID, CounterID, predicate), countIf(WatchID, predicate), groupBitOrIf(WatchID, predicate), groupBitAndIf(WatchID, predicate), groupBitXorIf(WatchID, predicate) FROM test.hits GROUP BY CounterID ORDER BY count() DESC LIMIT 20;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:22.066091 [ 3923 ] {2df13e39-c362-484c-81e1-e16bef5e7d06} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:22.605404 [ 3550 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column StartTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_2_2_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6592): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:22.913479 [ 5809 ] {1a047e00-f43f-4b6f-bbbc-49d40f22a974} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53600) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:22.964432 [ 5809 ] {1a047e00-f43f-4b6f-bbbc-49d40f22a974} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:23.856419 [ 3780 ] {fc030ec3-2321-4f0c-a96c-cf53a40823f9} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=21, jobs=21). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53584) (comment: 00047_bar.sql) (in query: SELECT CounterID, count() AS c, bar(c, 0, 523264) FROM test.hits GROUP BY CounterID ORDER BY c DESC, CounterID ASC LIMIT 100;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:37:24.468524 [ 5808 ] {3f5f07df-b81a-4a1d-ae13-e14ead28fc3c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=10, jobs=10). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53552) (comment: 03151_redundant_distinct_with_window.sql) (in query: select distinct type, sday from tab_v order by type, sday;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:37:24.596232 [ 5808 ] {3f5f07df-b81a-4a1d-ae13-e14ead28fc3c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=10, jobs=10). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:37:24.621930 [ 3780 ] {fc030ec3-2321-4f0c-a96c-cf53a40823f9} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=21, jobs=21). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:37:26.324047 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:27.598687 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:27.903441 [ 5724 ] {50a854d4-4030-4f39-b851-2f3b21a4dced} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=41, jobs=41). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47098) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:27.947499 [ 5724 ] {50a854d4-4030-4f39-b851-2f3b21a4dced} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=41, jobs=41). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:28.388221 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:28.642274 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/yjo/raenhjchrvwvvqnaccbwjqkelbdkh, total size 234881024, count 234881024, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 005221f8-85b0-49e9-b2e8-f6f4c601203c, upload has finished false.
2025.03.05 22:37:28.646116 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/yjo/raenhjchrvwvvqnaccbwjqkelbdkh, total size 234881024, count 234881024, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 005221f8-85b0-49e9-b2e8-f6f4c601203c, upload has finished false
2025.03.05 22:37:28.760385 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/yjo/raenhjchrvwvvqnaccbwjqkelbdkh, total size 234881024, count 234881024, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 005221f8-85b0-49e9-b2e8-f6f4c601203c, upload has finished false
2025.03.05 22:37:28.862800 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 52 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:28.995077 [ 5809 ] {996a733c-263e-4884-98e0-824ce3ca5836} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47114) (comment: 02246_tsv_csv_best_effort_schema_inference.sh) (in query: select * from file('test_02149.data', 'TSV')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:29.036292 [ 5809 ] {996a733c-263e-4884-98e0-824ce3ca5836} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:29.263121 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {0d6617f8-564f-43ff-a6dc-a74b9f150261::202503_1_73_14}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=12). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:29.486868 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {0d6617f8-564f-43ff-a6dc-a74b9f150261::202503_1_73_14}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:30.895249 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:32.697482 [ 5819 ] {b8a0cc49-4828-485b-8c6c-36cff5f12e5b} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=27, jobs=27). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47142) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:37:32.694416 [ 5724 ] {8fb60276-554c-491f-961c-f052bcc244eb} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=4): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47108) (comment: 00044_any_left_join_string.sql) (in query: SELECT domain, hits, visits FROM ( SELECT domain(URL) AS domain, count() AS hits FROM test.hits GROUP BY domain ) ANY LEFT JOIN ( SELECT domain(StartURL) AS domain, sum(Sign) AS visits FROM test.visits GROUP BY domain ) USING domain ORDER BY hits DESC LIMIT 10 SETTINGS joined_subquery_requires_alias = 0;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:37:32.722905 [ 5819 ] {b8a0cc49-4828-485b-8c6c-36cff5f12e5b} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=27, jobs=27). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:37:33.158047 [ 5724 ] {8fb60276-554c-491f-961c-f052bcc244eb} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=4): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:37:36.524138 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {0d6617f8-564f-43ff-a6dc-a74b9f150261::202503_1_73_14}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:45: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce470d
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:37.893412 [ 5808 ] {e331494a-e9bc-4f5a-951b-847882a111b3} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:57196) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:37.928118 [ 5808 ] {e331494a-e9bc-4f5a-951b-847882a111b3} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:39.731225 [ 5808 ] {f15a66cd-7c37-40a3-abba-3159106d5165} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=30, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:57222) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:39.768265 [ 5808 ] {f15a66cd-7c37-40a3-abba-3159106d5165} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=30, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:41.167302 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/non/vymiwrzdwncsvudgqtihqawjavquc, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4b31fb8f-f1a6-437b-96ee-df64064bfac7, upload has finished false.
2025.03.05 22:37:41.169373 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/non/vymiwrzdwncsvudgqtihqawjavquc, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4b31fb8f-f1a6-437b-96ee-df64064bfac7, upload has finished false
2025.03.05 22:37:41.227237 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/non/vymiwrzdwncsvudgqtihqawjavquc, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4b31fb8f-f1a6-437b-96ee-df64064bfac7, upload has finished false
2025.03.05 22:37:41.305808 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 27 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:41.407242 [ 3610 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:41.534706 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {0d6617f8-564f-43ff-a6dc-a74b9f150261::202503_1_73_14}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=1): (while reading column trace): (while reading from part /var/lib/clickhouse/disks/s3/store/0d6/0d6617f8-564f-43ff-a6dc-a74b9f150261/202503_1_68_13/ in table system.trace_log (0d6617f8-564f-43ff-a6dc-a74b9f150261) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/SerializationArray.cpp:248: DB::SerializationArray::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fdf237
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:42.196984 [ 5808 ] {9e7d50ad-1517-41a9-92c4-5431be9937c9} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:57224) (comment: 03149_analyzer_window_redefinition.sql) (in query: INSERT INTO users VALUES ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6

2025.03.05 22:37:42.206322 [ 5808 ] {9e7d50ad-1517-41a9-92c4-5431be9937c9} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6

2025.03.05 22:37:42.606718 [ 3923 ] {1fea902f-0be1-4226-aa51-cbc4d8519255} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=936, jobs=865). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:57240) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:37:42.650353 [ 3923 ] {1fea902f-0be1-4226-aa51-cbc4d8519255} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=936, jobs=865). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:37:44.639106 [ 5809 ] {ed5a07a5-669a-4ea6-b869-9c7c753e5a2f} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56676) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:37:44.673443 [ 5809 ] {ed5a07a5-669a-4ea6-b869-9c7c753e5a2f} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:37:46.337075 [ 5809 ] {eeceac3f-2943-4946-bdcd-3bca5a7a7683} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56684) (comment: 02246_tsv_csv_best_effort_schema_inference.sh) (in query: select * from file('test_02149.data', 'TSV')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:46.420066 [ 5809 ] {eeceac3f-2943-4946-bdcd-3bca5a7a7683} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:48.078596 [ 5809 ] {88201ee1-ace9-49c1-8a0e-8cd74eaceaff} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=18, jobs=18). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56696) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:37:48.130277 [ 5809 ] {88201ee1-ace9-49c1-8a0e-8cd74eaceaff} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=18, jobs=18). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:37:53.081866 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/ual/jypmdzctjcfsotmqrhnqteimllhaj, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 5ce22d27-1eea-408e-b91e-d57a3b5d2b28, upload has finished false.
2025.03.05 22:37:53.088490 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/ual/jypmdzctjcfsotmqrhnqteimllhaj, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 5ce22d27-1eea-408e-b91e-d57a3b5d2b28, upload has finished false
2025.03.05 22:37:53.149070 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/ual/jypmdzctjcfsotmqrhnqteimllhaj, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 5ce22d27-1eea-408e-b91e-d57a3b5d2b28, upload has finished false
2025.03.05 22:37:53.213258 [ 5809 ] {537ffa4b-adfc-45f2-aa68-d28421bda0ed} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56714) (comment: 01055_window_view_proc_hop_to.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:53.235825 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 32 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:53.274255 [ 5809 ] {537ffa4b-adfc-45f2-aa68-d28421bda0ed} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:37:54.127933 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7a26c9c9-7195-4e8c-807c-8ccd93ff5af2::202503_1_75_14}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:54.821080 [ 5809 ] {96c2a422-25a6-401f-886f-6a741f744267} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:49736) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:37:54.847074 [ 5809 ] {96c2a422-25a6-401f-886f-6a741f744267} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:37:55.836469 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:57.448863 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:59.403135 [ 3610 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:37:59.972435 [ 5819 ] {660a4ab5-ed7a-45fe-a81c-2e45ccd43a98} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:49766) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:38:00.003640 [ 5819 ] {660a4ab5-ed7a-45fe-a81c-2e45ccd43a98} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:38:04.251752 [ 5808 ] {42fc8620-8b6c-4401-a1c3-04a56a50b5c5} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 69.89 MiB (attempt to allocate chunk of 1332402 bytes), maximum: 9.31 GiB: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/1ac/1acd413c-abb9-47e7-b5ab-2834f577d1ca/201403_7_13_1/ in table test.hits (1acd413c-abb9-47e7-b5ab-2834f577d1ca) located on disk s3_disk of type s3, from mark 178 with max_rows_to_read = 24576): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (MEMORY_LIMIT_EXCEEDED) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:33238) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format TSV ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000132e9d7a
6. /build/src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e7feb
7. /build/src/Common/MemoryTracker.cpp:398: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e8862
8. /build/src/Common/CurrentMemoryTracker.cpp:58: CurrentMemoryTracker::allocImpl(long, bool) @ 0x00000000132554f1
9. /build/src/Common/CurrentMemoryTracker.cpp:90: CurrentMemoryTracker::alloc(long) @ 0x0000000013255701
10. /build/src/Common/Allocator.cpp:114: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000132536e6
11. /build/src/Common/PODArray.h:115: void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::alloc<>(unsigned long) @ 0x000000000a8fcba5
12. /build/src/Common/PODArray.h:141: void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::realloc<>(unsigned long) @ 0x000000000a8fcaf9
13. /build/src/Common/PODArray.h:0: void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000a8fbd15
14. /build/src/DataTypes/Serializations/SerializationFixedString.cpp:99: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000019ffa663
15. /build/src/DataTypes/Serializations/ISerialization.cpp:146: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000019fcf81a
16. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:363: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000001ce6a40c
17. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:151: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000001ce69de7
18. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:109: DB::MergeTreeRangeReader::DelayedStream::readRows(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, unsigned long) @ 0x000000001ce8370c
19. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:183: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000001ce839e4
20. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:295: DB::MergeTreeRangeReader::Stream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000001ce84305
21. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:1140: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000001ce8f091
22. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:1029: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000001ce8d52e
23. /build/src/Storages/MergeTree/MergeTreeReadTask.cpp:164: DB::MergeTreeReadTask::read(DB::MergeTreeReadTask::BlockSizeParams const&) @ 0x000000001ce97e89
24. /build/src/Storages/MergeTree/MergeTreeSelectAlgorithms.h:53: DB::MergeTreeInOrderSelectAlgorithm::readFromTask(DB::MergeTreeReadTask&, DB::MergeTreeReadTask::BlockSizeParams const&) @ 0x000000001ddec20c
25. /build/src/Storages/MergeTree/MergeTreeSelectProcessor.cpp:139: DB::MergeTreeSelectProcessor::read() @ 0x000000001ce7e9c3
26. /build/src/Storages/MergeTree/MergeTreeSource.cpp:226: DB::MergeTreeSource::tryGenerate() @ 0x000000001ddd7596
27. /build/src/Processors/ISource.cpp:108: DB::ISource::work() @ 0x000000001d4f69b6
28. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d5329e3
29. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d532720
30. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514ca1
31. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037

2025.03.05 22:38:05.222953 [ 3923 ] {cd032788-82cd-4dd0-8d4e-4af07a4b7e93} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42604) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:38:05.289280 [ 3923 ] {cd032788-82cd-4dd0-8d4e-4af07a4b7e93} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:38:06.687234 [ 5809 ] {77480868-8218-4bb4-9d86-aaa7a746e937} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:49754) (comment: 03145_non_loaded_projection_backup.sh) (in query: insert into tp_1 select number, number from numbers(4);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d511b1d
13. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d5119aa
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d511939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d51189d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'()::operator()() @ 0x000000001d5117a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5116f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5116d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5116a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:06.843015 [ 5809 ] {77480868-8218-4bb4-9d86-aaa7a746e937} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d511b1d
13. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d5119aa
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d511939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d51189d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'()::operator()() @ 0x000000001d5117a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5116f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5116d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5116a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:10.583509 [ 5808 ] {42fc8620-8b6c-4401-a1c3-04a56a50b5c5} <Error> DynamicQueryHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 69.89 MiB (attempt to allocate chunk of 1332402 bytes), maximum: 9.31 GiB: (while reading column ClientIP6): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/1ac/1acd413c-abb9-47e7-b5ab-2834f577d1ca/201403_7_13_1/ in table test.hits (1acd413c-abb9-47e7-b5ab-2834f577d1ca) located on disk s3_disk of type s3, from mark 178 with max_rows_to_read = 24576): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000132e9d7a
6. /build/src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e7feb
7. /build/src/Common/MemoryTracker.cpp:398: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e8862
8. /build/src/Common/CurrentMemoryTracker.cpp:58: CurrentMemoryTracker::allocImpl(long, bool) @ 0x00000000132554f1
9. /build/src/Common/CurrentMemoryTracker.cpp:90: CurrentMemoryTracker::alloc(long) @ 0x0000000013255701
10. /build/src/Common/Allocator.cpp:114: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000132536e6
11. /build/src/Common/PODArray.h:115: void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::alloc<>(unsigned long) @ 0x000000000a8fcba5
12. /build/src/Common/PODArray.h:141: void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::realloc<>(unsigned long) @ 0x000000000a8fcaf9
13. /build/src/Common/PODArray.h:0: void DB::PODArrayBase<1ul, 4096ul, Allocator<false, false>, 63ul, 64ul>::resize<>(unsigned long) @ 0x000000000a8fbd15
14. /build/src/DataTypes/Serializations/SerializationFixedString.cpp:99: DB::SerializationFixedString::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x0000000019ffa663
15. /build/src/DataTypes/Serializations/ISerialization.cpp:146: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000019fcf81a
16. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:363: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000001ce6a40c
17. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:151: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000001ce69de7
18. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:109: DB::MergeTreeRangeReader::DelayedStream::readRows(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&, unsigned long) @ 0x000000001ce8370c
19. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:183: DB::MergeTreeRangeReader::DelayedStream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000001ce839e4
20. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:295: DB::MergeTreeRangeReader::Stream::finalize(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000001ce84305
21. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:1140: DB::MergeTreeRangeReader::startReadingChain(unsigned long, DB::MarkRanges&) @ 0x000000001ce8f091
22. /build/src/Storages/MergeTree/MergeTreeRangeReader.cpp:1029: DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000001ce8d52e
23. /build/src/Storages/MergeTree/MergeTreeReadTask.cpp:164: DB::MergeTreeReadTask::read(DB::MergeTreeReadTask::BlockSizeParams const&) @ 0x000000001ce97e89
24. /build/src/Storages/MergeTree/MergeTreeSelectAlgorithms.h:53: DB::MergeTreeInOrderSelectAlgorithm::readFromTask(DB::MergeTreeReadTask&, DB::MergeTreeReadTask::BlockSizeParams const&) @ 0x000000001ddec20c
25. /build/src/Storages/MergeTree/MergeTreeSelectProcessor.cpp:139: DB::MergeTreeSelectProcessor::read() @ 0x000000001ce7e9c3
26. /build/src/Storages/MergeTree/MergeTreeSource.cpp:226: DB::MergeTreeSource::tryGenerate() @ 0x000000001ddd7596
27. /build/src/Processors/ISource.cpp:108: DB::ISource::work() @ 0x000000001d4f69b6
28. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d5329e3
29. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d532720
30. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514ca1
31. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:12.825394 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/vyv/ovzikibbzpqpnclpvwhtnthlcayij, total size 268435456, count 268435456, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id db95cf50-c93d-498e-afed-5d5b837d5009, upload has finished false.
2025.03.05 22:38:12.826840 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/vyv/ovzikibbzpqpnclpvwhtnthlcayij, total size 268435456, count 268435456, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id db95cf50-c93d-498e-afed-5d5b837d5009, upload has finished false
2025.03.05 22:38:12.929014 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/vyv/ovzikibbzpqpnclpvwhtnthlcayij, total size 268435456, count 268435456, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id db95cf50-c93d-498e-afed-5d5b837d5009, upload has finished false
2025.03.05 22:38:13.013337 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 56 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:14.254792 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column StartTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_3_3_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 1 with max_rows_to_read = 6608): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:14.836217 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:17.500776 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38ea0
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:18.556626 [ 5808 ] {92b8eb7d-cbb6-4754-beaa-6768b2a69637} <Error> BackupsWorker: Failed to make backup Disk('backups', '03145_non_loaded_projection_backup_test_mmikrxid'): Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:169: DB::ThreadPoolCallbackRunnerLocal<void, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>, std::function<void ()>>::operator()(std::function<void ()>&&, Priority) @ 0x0000000018f67c7a
10. /build/src/Backups/BackupsWorker.cpp:760: DB::BackupsWorker::writeBackupEntries(std::shared_ptr<DB::IBackup>, std::vector<std::pair<String, std::shared_ptr<DB::IBackupEntry const>>, std::allocator<std::pair<String, std::shared_ptr<DB::IBackupEntry const>>>>&&, String const&, std::shared_ptr<DB::IBackupCoordination>, bool, std::shared_ptr<DB::QueryStatus>) @ 0x00000000197dafa1
11. /build/src/Backups/BackupsWorker.cpp:642: DB::BackupsWorker::doBackup(std::shared_ptr<DB::IBackup>&, std::shared_ptr<DB::ASTBackupQuery> const&, String const&, String const&, DB::BackupInfo const&, DB::BackupSettings, std::shared_ptr<DB::IBackupCoordination>, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::Context>) @ 0x00000000197d8edb
12. /build/src/Backups/BackupsWorker.cpp:527: DB::BackupsWorker::startMakingBackup(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&) @ 0x00000000197d65a6
13. /build/src/Backups/BackupsWorker.cpp:405: DB::BackupsWorker::start(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x00000000197d5a65
14. /build/src/Interpreters/InterpreterBackupQuery.cpp:40: DB::InterpreterBackupQuery::execute() @ 0x000000001bc4ea81
15. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
16. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
17. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
18. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
19. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
20. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
21. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
22. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
23. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
24. ? @ 0x00007f7a996d8ac3
25. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:18.557312 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_107_117_2}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:18.557494 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 7 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:18.586699 [ 5808 ] {92b8eb7d-cbb6-4754-beaa-6768b2a69637} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:33764) (comment: 03145_non_loaded_projection_backup.sh) (in query:  backup table tp_1 to Disk('backups', '03145_non_loaded_projection_backup_test_mmikrxid'); ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:169: DB::ThreadPoolCallbackRunnerLocal<void, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>, std::function<void ()>>::operator()(std::function<void ()>&&, Priority) @ 0x0000000018f67c7a
10. /build/src/Backups/BackupsWorker.cpp:760: DB::BackupsWorker::writeBackupEntries(std::shared_ptr<DB::IBackup>, std::vector<std::pair<String, std::shared_ptr<DB::IBackupEntry const>>, std::allocator<std::pair<String, std::shared_ptr<DB::IBackupEntry const>>>>&&, String const&, std::shared_ptr<DB::IBackupCoordination>, bool, std::shared_ptr<DB::QueryStatus>) @ 0x00000000197dafa1
11. /build/src/Backups/BackupsWorker.cpp:642: DB::BackupsWorker::doBackup(std::shared_ptr<DB::IBackup>&, std::shared_ptr<DB::ASTBackupQuery> const&, String const&, String const&, DB::BackupInfo const&, DB::BackupSettings, std::shared_ptr<DB::IBackupCoordination>, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::Context>) @ 0x00000000197d8edb
12. /build/src/Backups/BackupsWorker.cpp:527: DB::BackupsWorker::startMakingBackup(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&) @ 0x00000000197d65a6
13. /build/src/Backups/BackupsWorker.cpp:405: DB::BackupsWorker::start(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x00000000197d5a65
14. /build/src/Interpreters/InterpreterBackupQuery.cpp:40: DB::InterpreterBackupQuery::execute() @ 0x000000001bc4ea81
15. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
16. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
17. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
18. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
19. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
20. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
21. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
22. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
23. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
24. ? @ 0x00007f7a996d8ac3
25. ? @ 0x00007f7a9976a850

2025.03.05 22:38:18.630580 [ 5808 ] {92b8eb7d-cbb6-4754-beaa-6768b2a69637} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:169: DB::ThreadPoolCallbackRunnerLocal<void, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>, std::function<void ()>>::operator()(std::function<void ()>&&, Priority) @ 0x0000000018f67c7a
10. /build/src/Backups/BackupsWorker.cpp:760: DB::BackupsWorker::writeBackupEntries(std::shared_ptr<DB::IBackup>, std::vector<std::pair<String, std::shared_ptr<DB::IBackupEntry const>>, std::allocator<std::pair<String, std::shared_ptr<DB::IBackupEntry const>>>>&&, String const&, std::shared_ptr<DB::IBackupCoordination>, bool, std::shared_ptr<DB::QueryStatus>) @ 0x00000000197dafa1
11. /build/src/Backups/BackupsWorker.cpp:642: DB::BackupsWorker::doBackup(std::shared_ptr<DB::IBackup>&, std::shared_ptr<DB::ASTBackupQuery> const&, String const&, String const&, DB::BackupInfo const&, DB::BackupSettings, std::shared_ptr<DB::IBackupCoordination>, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::Context>) @ 0x00000000197d8edb
12. /build/src/Backups/BackupsWorker.cpp:527: DB::BackupsWorker::startMakingBackup(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&) @ 0x00000000197d65a6
13. /build/src/Backups/BackupsWorker.cpp:405: DB::BackupsWorker::start(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x00000000197d5a65
14. /build/src/Interpreters/InterpreterBackupQuery.cpp:40: DB::InterpreterBackupQuery::execute() @ 0x000000001bc4ea81
15. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
16. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
17. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
18. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
19. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
20. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
21. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
22. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
23. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
24. ? @ 0x00007f7a996d8ac3
25. ? @ 0x00007f7a9976a850

2025.03.05 22:38:19.189800 [ 3633 ] {} <Error> void DB::SystemLog<DB::TraceLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:19.440056 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=1): (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_5_5_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6739): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:21.353873 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:22.734947 [ 3923 ] {b63db132-6c0f-4012-a83d-7a7b0eafd645} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=6): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:56208) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format TSV ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:38:22.975333 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 5 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:24.237566 [ 3580 ] {} <Warning> test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92): Removing temporary directory /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/tmp_merge_201403_1_6_1/
2025.03.05 22:38:24.238177 [ 3580 ] {} <Warning> test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/tmp_merge_201403_1_6_1/
2025.03.05 22:38:24.829921 [ 5808 ] {3eec63af-04ea-4e67-a690-e0c3321b9c4f} <Error> BackupsWorker: Failed to restore from backup Disk('backups', '03145_non_loaded_projection_backup_test_mmikrxid'): Code: 599. DB::Exception: Backup Disk('backups', '03145_non_loaded_projection_backup_test_mmikrxid') not found. (BACKUP_NOT_FOUND), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a941e33
6. /build/src/Backups/BackupImpl.cpp:438: DB::BackupImpl::readBackupMetadata() @ 0x0000000019894f87
7. /build/src/Backups/BackupImpl.cpp:195: DB::BackupImpl::open() @ 0x00000000198926fe
8. /build/src/Backups/BackupImpl.cpp:110: DB::BackupImpl::BackupImpl(DB::BackupInfo const&, DB::BackupImpl::ArchiveParams const&, std::optional<DB::BackupInfo> const&, std::shared_ptr<DB::IBackupReader>, std::shared_ptr<DB::Context const> const&, bool) @ 0x0000000019891390
9. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::BackupImpl>::__unique_single std::make_unique[abi:v15000]<DB::BackupImpl, DB::BackupInfo const&, DB::BackupImpl::ArchiveParams&, std::optional<DB::BackupInfo> const&, std::shared_ptr<DB::IBackupReader>&, std::shared_ptr<DB::Context const> const&, bool const&>(DB::BackupInfo const&, DB::BackupImpl::ArchiveParams&, std::optional<DB::BackupInfo> const&, std::shared_ptr<DB::IBackupReader>&, std::shared_ptr<DB::Context const> const&, bool const&) @ 0x00000000199260b1
10. /build/src/Backups/registerBackupEnginesFileAndDisk.cpp:174: DB::registerBackupEnginesFileAndDisk(DB::BackupFactory&)::$_0::operator()(DB::BackupFactory::CreateParams const&) const @ 0x0000000019924889
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019923d7d
12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x0000000019923cfd
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019923cbd
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019923c85
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000197f42fe
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000197f341d
17. /build/src/Backups/BackupFactory.cpp:24: DB::BackupFactory::createBackup(DB::BackupFactory::CreateParams const&) const @ 0x00000000197f3101
18. /build/src/Backups/BackupsWorker.cpp:913: DB::BackupsWorker::doRestore(std::shared_ptr<DB::ASTBackupQuery> const&, String const&, String const&, DB::BackupInfo const&, DB::RestoreSettings, std::shared_ptr<DB::IRestoreCoordination>, std::shared_ptr<DB::Context>) @ 0x00000000197dc2d8
19. /build/src/Backups/BackupsWorker.cpp:873: DB::BackupsWorker::startRestoring(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x00000000197d71af
20. /build/src/Backups/BackupsWorker.cpp:407: DB::BackupsWorker::start(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x00000000197d5ae1
21. /build/src/Interpreters/InterpreterBackupQuery.cpp:40: DB::InterpreterBackupQuery::execute() @ 0x000000001bc4ea81
22. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:24.830176 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:24.833229 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_4_4_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 1 with max_rows_to_read = 6741): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:24.834678 [ 5808 ] {3eec63af-04ea-4e67-a690-e0c3321b9c4f} <Error> executeQuery: Code: 599. DB::Exception: Backup Disk('backups', '03145_non_loaded_projection_backup_test_mmikrxid') not found. (BACKUP_NOT_FOUND) (version 24.3.12.76.altinitystable) (from [::1]:53338) (comment: 03145_non_loaded_projection_backup.sh) (in query: restore table tp_1 from Disk('backups', '03145_non_loaded_projection_backup_test_mmikrxid');), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a941e33
6. /build/src/Backups/BackupImpl.cpp:438: DB::BackupImpl::readBackupMetadata() @ 0x0000000019894f87
7. /build/src/Backups/BackupImpl.cpp:195: DB::BackupImpl::open() @ 0x00000000198926fe
8. /build/src/Backups/BackupImpl.cpp:110: DB::BackupImpl::BackupImpl(DB::BackupInfo const&, DB::BackupImpl::ArchiveParams const&, std::optional<DB::BackupInfo> const&, std::shared_ptr<DB::IBackupReader>, std::shared_ptr<DB::Context const> const&, bool) @ 0x0000000019891390
9. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::BackupImpl>::__unique_single std::make_unique[abi:v15000]<DB::BackupImpl, DB::BackupInfo const&, DB::BackupImpl::ArchiveParams&, std::optional<DB::BackupInfo> const&, std::shared_ptr<DB::IBackupReader>&, std::shared_ptr<DB::Context const> const&, bool const&>(DB::BackupInfo const&, DB::BackupImpl::ArchiveParams&, std::optional<DB::BackupInfo> const&, std::shared_ptr<DB::IBackupReader>&, std::shared_ptr<DB::Context const> const&, bool const&) @ 0x00000000199260b1
10. /build/src/Backups/registerBackupEnginesFileAndDisk.cpp:174: DB::registerBackupEnginesFileAndDisk(DB::BackupFactory&)::$_0::operator()(DB::BackupFactory::CreateParams const&) const @ 0x0000000019924889
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019923d7d
12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x0000000019923cfd
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019923cbd
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019923c85
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000197f42fe
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000197f341d
17. /build/src/Backups/BackupFactory.cpp:24: DB::BackupFactory::createBackup(DB::BackupFactory::CreateParams const&) const @ 0x00000000197f3101
18. /build/src/Backups/BackupsWorker.cpp:913: DB::BackupsWorker::doRestore(std::shared_ptr<DB::ASTBackupQuery> const&, String const&, String const&, DB::BackupInfo const&, DB::RestoreSettings, std::shared_ptr<DB::IRestoreCoordination>, std::shared_ptr<DB::Context>) @ 0x00000000197dc2d8
19. /build/src/Backups/BackupsWorker.cpp:873: DB::BackupsWorker::startRestoring(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x00000000197d71af
20. /build/src/Backups/BackupsWorker.cpp:407: DB::BackupsWorker::start(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x00000000197d5ae1
21. /build/src/Interpreters/InterpreterBackupQuery.cpp:40: DB::InterpreterBackupQuery::execute() @ 0x000000001bc4ea81
22. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:38:24.840671 [ 5808 ] {3eec63af-04ea-4e67-a690-e0c3321b9c4f} <Error> TCPHandler: Code: 599. DB::Exception: Backup Disk('backups', '03145_non_loaded_projection_backup_test_mmikrxid') not found. (BACKUP_NOT_FOUND), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a941e33
6. /build/src/Backups/BackupImpl.cpp:438: DB::BackupImpl::readBackupMetadata() @ 0x0000000019894f87
7. /build/src/Backups/BackupImpl.cpp:195: DB::BackupImpl::open() @ 0x00000000198926fe
8. /build/src/Backups/BackupImpl.cpp:110: DB::BackupImpl::BackupImpl(DB::BackupInfo const&, DB::BackupImpl::ArchiveParams const&, std::optional<DB::BackupInfo> const&, std::shared_ptr<DB::IBackupReader>, std::shared_ptr<DB::Context const> const&, bool) @ 0x0000000019891390
9. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::BackupImpl>::__unique_single std::make_unique[abi:v15000]<DB::BackupImpl, DB::BackupInfo const&, DB::BackupImpl::ArchiveParams&, std::optional<DB::BackupInfo> const&, std::shared_ptr<DB::IBackupReader>&, std::shared_ptr<DB::Context const> const&, bool const&>(DB::BackupInfo const&, DB::BackupImpl::ArchiveParams&, std::optional<DB::BackupInfo> const&, std::shared_ptr<DB::IBackupReader>&, std::shared_ptr<DB::Context const> const&, bool const&) @ 0x00000000199260b1
10. /build/src/Backups/registerBackupEnginesFileAndDisk.cpp:174: DB::registerBackupEnginesFileAndDisk(DB::BackupFactory&)::$_0::operator()(DB::BackupFactory::CreateParams const&) const @ 0x0000000019924889
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019923d7d
12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x0000000019923cfd
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019923cbd
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019923c85
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000197f42fe
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000197f341d
17. /build/src/Backups/BackupFactory.cpp:24: DB::BackupFactory::createBackup(DB::BackupFactory::CreateParams const&) const @ 0x00000000197f3101
18. /build/src/Backups/BackupsWorker.cpp:913: DB::BackupsWorker::doRestore(std::shared_ptr<DB::ASTBackupQuery> const&, String const&, String const&, DB::BackupInfo const&, DB::RestoreSettings, std::shared_ptr<DB::IRestoreCoordination>, std::shared_ptr<DB::Context>) @ 0x00000000197dc2d8
19. /build/src/Backups/BackupsWorker.cpp:873: DB::BackupsWorker::startRestoring(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x00000000197d71af
20. /build/src/Backups/BackupsWorker.cpp:407: DB::BackupsWorker::start(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context>) @ 0x00000000197d5ae1
21. /build/src/Interpreters/InterpreterBackupQuery.cpp:40: DB::InterpreterBackupQuery::execute() @ 0x000000001bc4ea81
22. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:38:24.911970 [ 3923 ] {b63db132-6c0f-4012-a83d-7a7b0eafd645} <Error> DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=6): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:26.000727 [ 5808 ] {fee20dcb-1275-4587-a2fe-8294537544d9} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:52958) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format CSV ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
21. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
22. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
23. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
24. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
25. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
26. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
27. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
28. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:26.011122 [ 5808 ] {fee20dcb-1275-4587-a2fe-8294537544d9} <Error> DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
21. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
22. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
23. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
24. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
25. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
26. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
27. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
28. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:26.780801 [ 3541 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 7 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:28.715097 [ 5808 ] {8cc960de-3523-49c2-90c4-1f529b9c41df} <Error> executeQuery: Code: 60. DB::Exception: Unknown table expression identifier 'tp_1' in scope SELECT count() FROM tp_1. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:53362) (comment: 03145_non_loaded_projection_backup.sh) (in query: select count() from tp_1;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a8b52
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09baa3
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:38:28.745059 [ 5808 ] {8cc960de-3523-49c2-90c4-1f529b9c41df} <Error> TCPHandler: Code: 60. DB::Exception: Unknown table expression identifier 'tp_1' in scope SELECT count() FROM tp_1. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6970: DB::(anonymous namespace)::QueryAnalyzer::initializeQueryJoinTreeNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a8b52
7. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8159: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09baa3
8. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
9. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
10. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
11. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
13. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
14. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
15. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001b422e9d
21. /build/src/Interpreters/InterpreterFactory.cpp:355: DB::InterpreterFactory::get(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context>, DB::SelectQueryOptions const&) @ 0x000000001b42252d
22. /build/src/Interpreters/executeQuery.cpp:1133: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0ab0
23. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
24. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
25. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
26. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
27. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
28. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
29. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
30. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
31. ? @ 0x00007f7a996d8ac3

2025.03.05 22:38:29.321310 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 3 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:31.115793 [ 3584 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Removing temporary directory /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:38:31.116669 [ 3584 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:38:31.340467 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:33.063965 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:33.674802 [ 5808 ] {0c203b40-abdc-4e57-9b1a-04bdbb313bb2} <Error> executeQuery: Code: 60. DB::Exception: Table test_mmikrxid.tp_1 does not exist. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:42472) (comment: 03145_non_loaded_projection_backup.sh) (in query: check table tp_1 settings check_query_single_value_result = 0;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Databases/IDatabase.cpp:37: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144972
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterCheckQuery.cpp:98: DB::(anonymous namespace)::TableCheckTask::TableCheckTask(DB::StorageID, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String> const&, std::shared_ptr<DB::Context const>) @ 0x000000001bc2e88d
10. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::(anonymous namespace)::TableCheckTask* std::construct_at[abi:v15000]<DB::(anonymous namespace)::TableCheckTask, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&, DB::(anonymous namespace)::TableCheckTask*>(DB::(anonymous namespace)::TableCheckTask*, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2e7b4
11. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::(anonymous namespace)::TableCheckTask>>::construct[abi:v15000]<DB::(anonymous namespace)::TableCheckTask, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&, void, void>(std::allocator<DB::(anonymous namespace)::TableCheckTask>&, DB::(anonymous namespace)::TableCheckTask*, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2e531
12. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::(anonymous namespace)::TableCheckTask, std::allocator<DB::(anonymous namespace)::TableCheckTask>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&>(std::allocator<DB::(anonymous namespace)::TableCheckTask>, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2e237
13. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::(anonymous namespace)::TableCheckTask> std::allocate_shared[abi:v15000]<DB::(anonymous namespace)::TableCheckTask, std::allocator<DB::(anonymous namespace)::TableCheckTask>, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&, void>(std::allocator<DB::(anonymous namespace)::TableCheckTask> const&, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2e0aa
14. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::(anonymous namespace)::TableCheckTask> std::make_shared[abi:v15000]<DB::(anonymous namespace)::TableCheckTask, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&, void>(DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2d036
15. /build/src/Interpreters/InterpreterCheckQuery.cpp:398: DB::InterpreterCheckQuery::execute() @ 0x000000001bc2b7a3
16. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
17. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
18. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
19. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
20. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
21. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
22. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
23. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
24. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
25. ? @ 0x00007f7a996d8ac3
26. ? @ 0x00007f7a9976a850

2025.03.05 22:38:33.691294 [ 5808 ] {0c203b40-abdc-4e57-9b1a-04bdbb313bb2} <Error> TCPHandler: Code: 60. DB::Exception: Table test_mmikrxid.tp_1 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Databases/IDatabase.cpp:37: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144972
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterCheckQuery.cpp:98: DB::(anonymous namespace)::TableCheckTask::TableCheckTask(DB::StorageID, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String> const&, std::shared_ptr<DB::Context const>) @ 0x000000001bc2e88d
10. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::(anonymous namespace)::TableCheckTask* std::construct_at[abi:v15000]<DB::(anonymous namespace)::TableCheckTask, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&, DB::(anonymous namespace)::TableCheckTask*>(DB::(anonymous namespace)::TableCheckTask*, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2e7b4
11. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::(anonymous namespace)::TableCheckTask>>::construct[abi:v15000]<DB::(anonymous namespace)::TableCheckTask, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&, void, void>(std::allocator<DB::(anonymous namespace)::TableCheckTask>&, DB::(anonymous namespace)::TableCheckTask*, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2e531
12. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::(anonymous namespace)::TableCheckTask, std::allocator<DB::(anonymous namespace)::TableCheckTask>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&>(std::allocator<DB::(anonymous namespace)::TableCheckTask>, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2e237
13. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::(anonymous namespace)::TableCheckTask> std::allocate_shared[abi:v15000]<DB::(anonymous namespace)::TableCheckTask, std::allocator<DB::(anonymous namespace)::TableCheckTask>, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&, void>(std::allocator<DB::(anonymous namespace)::TableCheckTask> const&, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2e0aa
14. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::(anonymous namespace)::TableCheckTask> std::make_shared[abi:v15000]<DB::(anonymous namespace)::TableCheckTask, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&, void>(DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2d036
15. /build/src/Interpreters/InterpreterCheckQuery.cpp:398: DB::InterpreterCheckQuery::execute() @ 0x000000001bc2b7a3
16. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
17. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
18. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
19. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
20. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
21. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
22. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
23. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
24. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
25. ? @ 0x00007f7a996d8ac3
26. ? @ 0x00007f7a9976a850

2025.03.05 22:38:36.170664 [ 5724 ] {32124b06-39a9-4968-b979-2d540ed2933d} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=35, jobs=35). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42502) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:38:36.189027 [ 5724 ] {32124b06-39a9-4968-b979-2d540ed2933d} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=35, jobs=35). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:38:37.833535 [ 5809 ] {deebfd33-05ff-44ac-a353-338d730ef307} <Error> executeQuery: Code: 60. DB::Exception: Table test_mmikrxid.tp_1 does not exist. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:42518) (comment: 03145_non_loaded_projection_backup.sh) (in query: check table tp_1), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Databases/IDatabase.cpp:37: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144972
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterCheckQuery.cpp:98: DB::(anonymous namespace)::TableCheckTask::TableCheckTask(DB::StorageID, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String> const&, std::shared_ptr<DB::Context const>) @ 0x000000001bc2e88d
10. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::(anonymous namespace)::TableCheckTask* std::construct_at[abi:v15000]<DB::(anonymous namespace)::TableCheckTask, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&, DB::(anonymous namespace)::TableCheckTask*>(DB::(anonymous namespace)::TableCheckTask*, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2e7b4
11. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::(anonymous namespace)::TableCheckTask>>::construct[abi:v15000]<DB::(anonymous namespace)::TableCheckTask, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&, void, void>(std::allocator<DB::(anonymous namespace)::TableCheckTask>&, DB::(anonymous namespace)::TableCheckTask*, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2e531
12. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::(anonymous namespace)::TableCheckTask, std::allocator<DB::(anonymous namespace)::TableCheckTask>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&>(std::allocator<DB::(anonymous namespace)::TableCheckTask>, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2e237
13. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::(anonymous namespace)::TableCheckTask> std::allocate_shared[abi:v15000]<DB::(anonymous namespace)::TableCheckTask, std::allocator<DB::(anonymous namespace)::TableCheckTask>, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&, void>(std::allocator<DB::(anonymous namespace)::TableCheckTask> const&, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2e0aa
14. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::(anonymous namespace)::TableCheckTask> std::make_shared[abi:v15000]<DB::(anonymous namespace)::TableCheckTask, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&, void>(DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2d036
15. /build/src/Interpreters/InterpreterCheckQuery.cpp:398: DB::InterpreterCheckQuery::execute() @ 0x000000001bc2b7a3
16. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
17. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
18. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
19. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
20. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
21. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
22. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
23. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
24. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
25. ? @ 0x00007f7a996d8ac3
26. ? @ 0x00007f7a9976a850

2025.03.05 22:38:37.840259 [ 5809 ] {deebfd33-05ff-44ac-a353-338d730ef307} <Error> TCPHandler: Code: 60. DB::Exception: Table test_mmikrxid.tp_1 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Databases/IDatabase.cpp:37: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144972
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:952: DB::DatabaseCatalog::getTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6740e3
9. /build/src/Interpreters/InterpreterCheckQuery.cpp:98: DB::(anonymous namespace)::TableCheckTask::TableCheckTask(DB::StorageID, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String> const&, std::shared_ptr<DB::Context const>) @ 0x000000001bc2e88d
10. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::(anonymous namespace)::TableCheckTask* std::construct_at[abi:v15000]<DB::(anonymous namespace)::TableCheckTask, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&, DB::(anonymous namespace)::TableCheckTask*>(DB::(anonymous namespace)::TableCheckTask*, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2e7b4
11. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::(anonymous namespace)::TableCheckTask>>::construct[abi:v15000]<DB::(anonymous namespace)::TableCheckTask, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&, void, void>(std::allocator<DB::(anonymous namespace)::TableCheckTask>&, DB::(anonymous namespace)::TableCheckTask*, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2e531
12. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::(anonymous namespace)::TableCheckTask, std::allocator<DB::(anonymous namespace)::TableCheckTask>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&>(std::allocator<DB::(anonymous namespace)::TableCheckTask>, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2e237
13. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::(anonymous namespace)::TableCheckTask> std::allocate_shared[abi:v15000]<DB::(anonymous namespace)::TableCheckTask, std::allocator<DB::(anonymous namespace)::TableCheckTask>, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&, void>(std::allocator<DB::(anonymous namespace)::TableCheckTask> const&, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2e0aa
14. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::(anonymous namespace)::TableCheckTask> std::make_shared[abi:v15000]<DB::(anonymous namespace)::TableCheckTask, DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>, std::shared_ptr<DB::Context const> const&, void>(DB::StorageID&, std::variant<std::monostate, std::shared_ptr<DB::IAST>, String>&&, std::shared_ptr<DB::Context const> const&) @ 0x000000001bc2d036
15. /build/src/Interpreters/InterpreterCheckQuery.cpp:398: DB::InterpreterCheckQuery::execute() @ 0x000000001bc2b7a3
16. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
17. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
18. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
19. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
20. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
21. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
22. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
23. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
24. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
25. ? @ 0x00007f7a996d8ac3
26. ? @ 0x00007f7a9976a850

2025.03.05 22:38:38.057502 [ 3633 ] {} <Error> void DB::SystemLog<DB::TraceLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:39.966488 [ 5819 ] {838a03e0-0813-49fc-98da-9d6a7462cdfb} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:52970) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format CSV ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:38:40.399453 [ 3923 ] {35116676-e8b8-4d21-87f9-4a466900cca8} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:38524) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `__table1`.`CounterID` AS `CounterID`, quantileTiming(0.5)(`__table1`.`SendTiming`) AS `quantileTiming(0.5)(SendTiming)`, count() AS `count()` FROM `test`.`hits` AS `__table1` WHERE `__table1`.`SendTiming` != -1 GROUP BY `__table1`.`CounterID`), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:38:40.464710 [ 3923 ] {35116676-e8b8-4d21-87f9-4a466900cca8} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:38:41.172831 [ 8746 ] {0cc30a48-6109-405e-b9b6-3e4bb0b492ea} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=41, jobs=41). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42530) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:38:41.245423 [ 8746 ] {0cc30a48-6109-405e-b9b6-3e4bb0b492ea} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=41, jobs=41). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:38:41.888111 [ 5819 ] {838a03e0-0813-49fc-98da-9d6a7462cdfb} <Error> DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:42.492566 [ 3923 ] {fa5311b8-147f-4d53-ad5d-5a5bf3920e6d} <Error> executeQuery: Code: 60. DB::Exception: Table test_mmikrxid.tp_1 does not exist. (UNKNOWN_TABLE) (version 24.3.12.76.altinitystable) (from [::1]:42534) (comment: 03145_non_loaded_projection_backup.sh) (in query: drop table tp_1), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Databases/IDatabase.cpp:37: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144972
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:966: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6742d8
9. /build/src/Interpreters/InterpreterDropQuery.cpp:131: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr<DB::Context const>, DB::ASTDropQuery&, std::shared_ptr<DB::IDatabase>&, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>&) @ 0x000000001b03ad01
10. /build/src/Interpreters/InterpreterDropQuery.cpp:102: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000001b03a394
11. /build/src/Interpreters/InterpreterDropQuery.cpp:73: DB::InterpreterDropQuery::execute() @ 0x000000001b03994e
12. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
21. ? @ 0x00007f7a996d8ac3
22. ? @ 0x00007f7a9976a850

2025.03.05 22:38:42.507927 [ 3923 ] {fa5311b8-147f-4d53-ad5d-5a5bf3920e6d} <Error> TCPHandler: Code: 60. DB::Exception: Table test_mmikrxid.tp_1 does not exist. (UNKNOWN_TABLE), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x000000000a8f15cc
6. /build/src/Databases/IDatabase.cpp:37: DB::IDatabase::getTable(String const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a144972
7. /build/src/Interpreters/DatabaseCatalog.cpp:429: DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::shared_ptr<DB::Context const>, std::optional<DB::Exception>*) const @ 0x000000001a66ed96
8. /build/src/Interpreters/DatabaseCatalog.cpp:966: DB::DatabaseCatalog::getDatabaseAndTable(DB::StorageID const&, std::shared_ptr<DB::Context const>) const @ 0x000000001a6742d8
9. /build/src/Interpreters/InterpreterDropQuery.cpp:131: DB::InterpreterDropQuery::executeToTableImpl(std::shared_ptr<DB::Context const>, DB::ASTDropQuery&, std::shared_ptr<DB::IDatabase>&, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>&) @ 0x000000001b03ad01
10. /build/src/Interpreters/InterpreterDropQuery.cpp:102: DB::InterpreterDropQuery::executeToTable(DB::ASTDropQuery&) @ 0x000000001b03a394
11. /build/src/Interpreters/InterpreterDropQuery.cpp:73: DB::InterpreterDropQuery::execute() @ 0x000000001b03994e
12. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
21. ? @ 0x00007f7a996d8ac3
22. ? @ 0x00007f7a9976a850

2025.03.05 22:38:43.900187 [ 8741 ] {e9003961-c08c-4b11-ae4f-0295c9202aa2} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:48690) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `__table1`.`CounterID` AS `CounterID`, quantileTiming(0.5)(`__table1`.`SendTiming`) AS `quantileTiming(0.5)(SendTiming)`, count() AS `count()` FROM `test`.`hits` AS `__table1` WHERE `__table1`.`SendTiming` != -1 GROUP BY `__table1`.`CounterID`), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:38:44.432392 [ 8742 ] {473de62f-d8e2-4350-b9fe-cd68e11fe289} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:44314) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `__table1`.`CounterID` AS `CounterID`, quantileTiming(0.5)(`__table1`.`SendTiming`) AS `quantileTiming(0.5)(SendTiming)`, count() AS `count()` FROM `test`.`hits` AS `__table1` WHERE `__table1`.`SendTiming` != -1 GROUP BY `__table1`.`CounterID`), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:44.449625 [ 8741 ] {e9003961-c08c-4b11-ae4f-0295c9202aa2} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:38:44.647765 [ 8743 ] {3834d18c-4b91-40ea-bcec-d6e8357d6562} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:52212) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `__table1`.`CounterID` AS `CounterID`, quantileTiming(0.5)(`__table1`.`SendTiming`) AS `quantileTiming(0.5)(SendTiming)`, count() AS `count()` FROM `test`.`hits` AS `__table1` WHERE `__table1`.`SendTiming` != -1 GROUP BY `__table1`.`CounterID`), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:44.958119 [ 8744 ] {5ef7725d-7319-44a1-9bad-58ce33dde553} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:60680) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `__table1`.`CounterID` AS `CounterID`, quantileTiming(0.5)(`__table1`.`SendTiming`) AS `quantileTiming(0.5)(SendTiming)`, count() AS `count()` FROM `test`.`hits` AS `__table1` WHERE `__table1`.`SendTiming` != -1 GROUP BY `__table1`.`CounterID`), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:45.098068 [ 8742 ] {473de62f-d8e2-4350-b9fe-cd68e11fe289} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:45.156313 [ 8746 ] {0405fbf5-d2f5-447e-a53b-4493a9a303b1} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:43748) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format JSONCompactEachRow ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5110c8
13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb5220
14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
22. ? @ 0x00007f7a996d8ac3
23. ? @ 0x00007f7a9976a850

2025.03.05 22:38:45.181316 [ 8743 ] {3834d18c-4b91-40ea-bcec-d6e8357d6562} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:45.372485 [ 8748 ] {9725794a-c73a-4977-bd0b-ea1802e4264e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=23). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42522) (comment: 02233_set_enable_with_statement_cte_perf.sql) (in query: INSERT INTO ev SELECT number, number FROM numbers(10000000);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d

2025.03.05 22:38:45.435885 [ 5809 ] {a8aa49e5-d958-473f-a63b-f7806b17b22a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:56564) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `__table1`.`CounterID` AS `CounterID`, quantileTiming(0.5)(`__table1`.`SendTiming`) AS `quantileTiming(0.5)(SendTiming)`, count() AS `count()` FROM `test`.`hits` AS `__table1` WHERE `__table1`.`SendTiming` != -1 GROUP BY `__table1`.`CounterID`), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:45.771586 [ 8748 ] {9725794a-c73a-4977-bd0b-ea1802e4264e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=23). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d

2025.03.05 22:38:45.856544 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7a26c9c9-7195-4e8c-807c-8ccd93ff5af2::202503_1_80_15}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:46.111851 [ 3780 ] {cbc754fa-b650-4554-8053-0489c9ca1b16} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:35362) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `__table1`.`CounterID` AS `CounterID`, quantileTiming(0.5)(`__table1`.`SendTiming`) AS `quantileTiming(0.5)(SendTiming)`, count() AS `count()` FROM `test`.`hits` AS `__table1` WHERE `__table1`.`SendTiming` != -1 GROUP BY `__table1`.`CounterID`), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:46.157701 [ 8746 ] {0405fbf5-d2f5-447e-a53b-4493a9a303b1} <Error> DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:110: DB::CompletedPipelineExecutor::execute() @ 0x000000001d5110c8
13. /build/src/Interpreters/executeQuery.cpp:1601: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb5220
14. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
15. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
16. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
17. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
18. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
19. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
20. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
21. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
22. ? @ 0x00007f7a996d8ac3
23. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:46.306361 [ 5809 ] {a8aa49e5-d958-473f-a63b-f7806b17b22a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:46.358050 [ 5808 ] {5eee563a-ebf2-4fe4-9333-ed70647c0f29} <Error> executeQuery: Code: 439. DB::Exception: Received from 127.0.0.3:9000. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). Stack trace:

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850
: While executing Remote. (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42484) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT sum(cityHash64(*)) FROM (SELECT CounterID, quantileTiming(0.5)(SendTiming), count() FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9,10}', test.hits) WHERE SendTiming != -1 GROUP BY CounterID);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a941aaa
5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a941a55
6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013368d82
7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bca59
8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c3fb1
9. /build/src/Client/PacketReceiver.cpp:66: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000001d330ea4
10. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000019ebcc69
11. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>::operator()(boost::context::fiber&&) @ 0x0000000019ebcb78
12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebcb08
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebcac8
14. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run(void*) @ 0x0000000019ebc9fe
15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry<boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(boost::context::detail::transfer_t) @ 0x0000000019ebc71d

2025.03.05 22:38:46.561291 [ 4789 ] {da58c70f-e215-471c-b6f0-0ba7ad530939} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:34350) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `__table1`.`CounterID` AS `CounterID`, quantileTiming(0.5)(`__table1`.`SendTiming`) AS `quantileTiming(0.5)(SendTiming)`, count() AS `count()` FROM `test`.`hits` AS `__table1` WHERE `__table1`.`SendTiming` != -1 GROUP BY `__table1`.`CounterID`), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:46.679641 [ 8744 ] {5ef7725d-7319-44a1-9bad-58ce33dde553} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:47.061160 [ 5808 ] {5eee563a-ebf2-4fe4-9333-ed70647c0f29} <Error> TCPHandler: Code: 439. DB::Exception: Received from 127.0.0.3:9000. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). Stack trace:

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850
: While executing Remote. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a941aaa
5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a941a55
6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013368d82
7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bca59
8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c3fb1
9. /build/src/Client/PacketReceiver.cpp:66: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000001d330ea4
10. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000019ebcc69
11. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>::operator()(boost::context::fiber&&) @ 0x0000000019ebcb78
12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebcb08
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebcac8
14. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run(void*) @ 0x0000000019ebc9fe
15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry<boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(boost::context::detail::transfer_t) @ 0x0000000019ebc71d

2025.03.05 22:38:47.062553 [ 8744 ] {5ef7725d-7319-44a1-9bad-58ce33dde553} <Warning> TCPHandler: Client has gone away.
2025.03.05 22:38:47.072990 [ 5819 ] {2c94c000-e0fd-48b6-a407-e4865f502e00} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=38, jobs=38). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42578) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:47.085230 [ 3780 ] {cbc754fa-b650-4554-8053-0489c9ca1b16} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:47.087809 [ 3780 ] {cbc754fa-b650-4554-8053-0489c9ca1b16} <Warning> TCPHandler: Client has gone away.
2025.03.05 22:38:47.079927 [ 5809 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:56564). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e5d2c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e4ea0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5da6a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46d877
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
15. ? @ 0x00007f7a996d8ac3
16. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:47.156132 [ 4789 ] {da58c70f-e215-471c-b6f0-0ba7ad530939} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:47.166816 [ 5724 ] {} <Error> ServerErrorHandler: Code: 210. DB::NetException: Connection reset by peer, while reading from socket ([::ffff:127.0.0.1]:52868). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&) @ 0x00000000134e5d2c
6. /build/src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x00000000134e4ea0
7. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5da6a
8. /build/src/IO/ReadBuffer.h:106: DB::TCPHandler::runImpl() @ 0x000000001d46d877
9. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
10. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
11. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
12. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
13. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
14. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
15. ? @ 0x00007f7a996d8ac3
16. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:47.178520 [ 4789 ] {da58c70f-e215-471c-b6f0-0ba7ad530939} <Warning> TCPHandler: Client has gone away.
2025.03.05 22:38:47.203379 [ 5819 ] {2c94c000-e0fd-48b6-a407-e4865f502e00} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=38, jobs=38). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:47.481657 [ 4786 ] {d824813d-83b2-498a-b9a0-555b8a0c3b76} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:48526). (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:48526) (comment: 00149_quantiles_timing_distributed.sql) (in query: SELECT `__table1`.`CounterID` AS `CounterID`, quantileTiming(0.5)(`__table1`.`SendTiming`) AS `quantileTiming(0.5)(SendTiming)`, count() AS `count()` FROM `test`.`hits` AS `__table1` WHERE `__table1`.`SendTiming` != -1 GROUP BY `__table1`.`CounterID`), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:158: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e75a4
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Server/TCPHandler.cpp:2283: DB::TCPHandler::sendEndOfStream() @ 0x000000001d47ace3
9. /build/src/Server/TCPHandler.cpp:596: DB::TCPHandler::runImpl() @ 0x000000001d46f115
10. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
16. ? @ 0x00007f7a996d8ac3
17. ? @ 0x00007f7a9976a850

2025.03.05 22:38:47.505656 [ 4786 ] {d824813d-83b2-498a-b9a0-555b8a0c3b76} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:48526). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e7844
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Server/TCPHandler.cpp:2253: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000001d485e55
9. /build/src/Server/TCPHandler.cpp:2330: DB::TCPHandler::sendLogs() @ 0x000000001d47abff
10. /build/src/Server/TCPHandler.cpp:693: DB::TCPHandler::runImpl() @ 0x000000001d4700c2
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:47.509760 [ 4786 ] {d824813d-83b2-498a-b9a0-555b8a0c3b76} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.4]:9000 -> [::ffff:127.0.0.1]:48526). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:158: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e75a4
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Server/TCPHandler.cpp:2283: DB::TCPHandler::sendEndOfStream() @ 0x000000001d47ace3
9. /build/src/Server/TCPHandler.cpp:596: DB::TCPHandler::runImpl() @ 0x000000001d46f115
10. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
11. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
12. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
13. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
14. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
15. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
16. ? @ 0x00007f7a996d8ac3
17. ? @ 0x00007f7a9976a850

2025.03.05 22:38:47.526576 [ 4786 ] {d824813d-83b2-498a-b9a0-555b8a0c3b76} <Warning> TCPHandler: Client has gone away.
2025.03.05 22:38:49.125160 [ 5808 ] {b1fc87ec-6308-4157-a760-bef2ca0aa4b2} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42592) (comment: 02246_tsv_csv_best_effort_schema_inference.sh) (in query: select * from file('test_02149.data', 'TSV')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:38:49.144057 [ 5808 ] {b1fc87ec-6308-4157-a760-bef2ca0aa4b2} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:38:49.434679 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:51.288306 [ 5808 ] {9326b1a3-7cae-4464-930d-f04aa531639e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42598) (comment: 02001_select_with_filter.sql) (in query: SELECT argMax(number, number + 1) FILTER(WHERE number != 99) FROM numbers(100) ;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:51.395514 [ 5808 ] {9326b1a3-7cae-4464-930d-f04aa531639e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:38:53.070821 [ 5809 ] {f8dcf42c-f947-40ef-898c-3621dff281de} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=962, jobs=843). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42602) (comment: 00022_merge_prewhere.sql) (in query: SELECT count() FROM test.merge_hits WHERE AdvEngineID = 2;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:38:53.229096 [ 5809 ] {f8dcf42c-f947-40ef-898c-3621dff281de} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=962, jobs=843). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:38:53.666936 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {1c723b97-5f9d-496d-81d4-e674245041aa::202503_1_65_13}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:54.626100 [ 3552 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/gbw/lrlonawylbrvixmlozrnyahlrpmmf, total size 285212672, count 285212672, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 9147f74e-8134-4950-a0ba-1f0a9ee5a6ab, upload has finished false.
2025.03.05 22:38:54.633395 [ 3552 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/gbw/lrlonawylbrvixmlozrnyahlrpmmf, total size 285212672, count 285212672, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 9147f74e-8134-4950-a0ba-1f0a9ee5a6ab, upload has finished false
2025.03.05 22:38:54.738843 [ 3552 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/gbw/lrlonawylbrvixmlozrnyahlrpmmf, total size 285212672, count 285212672, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 9147f74e-8134-4950-a0ba-1f0a9ee5a6ab, upload has finished false
2025.03.05 22:38:55.018034 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 60 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:38:55.032132 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:00.232221 [ 5724 ] {a223308a-522e-457a-a9b9-9f0dc9e06415} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41660) (comment: 01213_optimize_skip_unused_shards_DISTINCT.sql) (in query: SELECT DISTINCT `__table1`.`id` AS `id` FROM `test_9`.`local_01213` AS `__table1` WHERE `__table1`.`id` = 1), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:00.242572 [ 5724 ] {a223308a-522e-457a-a9b9-9f0dc9e06415} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:00.410324 [ 5808 ] {2682aa49-e2d3-4580-b6d5-bde98d5035d7} <Error> executeQuery: Code: 439. DB::Exception: Received from localhost:9000. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). Stack trace:

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850
: While executing Remote. (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41610) (comment: 01213_optimize_skip_unused_shards_DISTINCT.sql) (in query: SELECT DISTINCT id FROM dist_01213 WHERE id = 1 SETTINGS distributed_group_by_no_merge=1;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a941aaa
5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a941a55
6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013368d82
7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bca59
8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c3fb1
9. /build/src/Client/PacketReceiver.cpp:66: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000001d330ea4
10. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000019ebcc69
11. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>::operator()(boost::context::fiber&&) @ 0x0000000019ebcb78
12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebcb08
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebcac8
14. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run(void*) @ 0x0000000019ebc9fe
15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry<boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(boost::context::detail::transfer_t) @ 0x0000000019ebc71d

2025.03.05 22:39:00.429461 [ 5808 ] {2682aa49-e2d3-4580-b6d5-bde98d5035d7} <Error> TCPHandler: Code: 439. DB::Exception: Received from localhost:9000. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). Stack trace:

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850
: While executing Remote. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a941aaa
5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a941a55
6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013368d82
7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bca59
8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c3fb1
9. /build/src/Client/PacketReceiver.cpp:66: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000001d330ea4
10. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000019ebcc69
11. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>::operator()(boost::context::fiber&&) @ 0x0000000019ebcb78
12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebcb08
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebcac8
14. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run(void*) @ 0x0000000019ebc9fe
15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry<boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(boost::context::detail::transfer_t) @ 0x0000000019ebc71d

2025.03.05 22:39:00.857167 [ 5819 ] {8e662daf-07c4-4e32-b855-cac910d75a7c} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::1]:9000 -> [::1]:41666). (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::1]:41666) (comment: 01213_optimize_skip_unused_shards_DISTINCT.sql) (in query: SELECT DISTINCT `__table1`.`id` AS `id` FROM `test_9`.`local_01213` AS `__table1` WHERE `__table1`.`id` = 1), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:158: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e75a4
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Server/TCPHandler.cpp:2216: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001d47c172
9. /build/src/Server/TCPHandler.cpp:1084: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479faa
10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:39:00.922896 [ 5819 ] {8e662daf-07c4-4e32-b855-cac910d75a7c} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:41666). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e7844
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Server/TCPHandler.cpp:2253: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000001d485e55
9. /build/src/Server/TCPHandler.cpp:2330: DB::TCPHandler::sendLogs() @ 0x000000001d47abff
10. /build/src/Server/TCPHandler.cpp:693: DB::TCPHandler::runImpl() @ 0x000000001d4700c2
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:00.943090 [ 5819 ] {8e662daf-07c4-4e32-b855-cac910d75a7c} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::1]:9000 -> [::1]:41666). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:158: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e75a4
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Server/TCPHandler.cpp:2216: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001d47c172
9. /build/src/Server/TCPHandler.cpp:1084: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479faa
10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:39:00.966360 [ 5819 ] {8e662daf-07c4-4e32-b855-cac910d75a7c} <Warning> TCPHandler: Client has gone away.
2025.03.05 22:39:01.585350 [ 5809 ] {cef96ad7-f7e5-4816-98c5-097e3fe90cff} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41646) (comment: 00038_uniq_state_merge2.sql) (in query: SELECT topLevelDomain(concat('http://', k)) AS tld, sum(u) AS u, uniqMerge(us) AS us FROM (SELECT domain(URL) AS k, uniq(UserID) AS u, uniqState(UserID) AS us FROM test.hits GROUP BY k) GROUP BY tld ORDER BY u DESC, tld ASC LIMIT 100 ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:39:02.825069 [ 3923 ] {20676f1b-61c8-488b-942c-07ff653b76c8} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=8): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:42820) (comment: 00159_parallel_formatting_http.sh) (in query: SELECT ClientEventTime::DateTime('Asia/Dubai') as a,MobilePhoneModel as b,ClientIP6 as c FROM test.hits ORDER BY a,b,c LIMIT 1000000 Format JSONCompactEachRow ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:39:03.638393 [ 5809 ] {cef96ad7-f7e5-4816-98c5-097e3fe90cff} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:39:05.337028 [ 5808 ] {483b66ff-a19a-4ff5-ae7e-99f430863b53} <Error> executeQuery: Code: 36. DB::Exception: Expression in arrayJoin cannot depend on lambda argument: array(x, 1_UInt8) . (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:56618) (comment: 01330_array_join_in_higher_order_function.sql) (in query: SELECT arrayMap(x -> arrayJoin([x, 1]), [1, 2]);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x000000000a941553
6. /build/src/Planner/PlannerActionsVisitor.cpp:1007: DB::(anonymous namespace)::PlannerActionsVisitorImpl::visitFunction(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001a4a73e0
7. /build/src/Planner/PlannerActionsVisitor.cpp:658: DB::(anonymous namespace)::PlannerActionsVisitorImpl::visitImpl(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001a4a60e9
8. /build/src/Planner/PlannerActionsVisitor.cpp:782: DB::(anonymous namespace)::PlannerActionsVisitorImpl::visitLambda(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001a4a9cce
9. /build/src/Planner/PlannerActionsVisitor.cpp:986: DB::(anonymous namespace)::PlannerActionsVisitorImpl::visitFunction(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001a4a7030
10. /build/src/Planner/PlannerActionsVisitor.cpp:658: DB::(anonymous namespace)::PlannerActionsVisitorImpl::visitImpl(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001a4a60e9
11. /build/src/Planner/PlannerActionsVisitor.cpp:636: DB::(anonymous namespace)::PlannerActionsVisitorImpl::visit(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001a4a1b08
12. /build/src/Planner/PlannerActionsVisitor.cpp:1043: DB::PlannerActionsVisitor::visit(std::shared_ptr<DB::ActionsDAG>, std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001a4a1818
13. /build/src/Planner/Utils.cpp:242: DB::buildActionsDAGFromExpressionNode(std::shared_ptr<DB::IQueryTreeNode> const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::PlannerContext> const&) @ 0x000000001b5310a5
14. /build/src/Planner/PlannerExpressionAnalysis.cpp:360: DB::(anonymous namespace)::analyzeProjection(DB::QueryNode const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::PlannerContext> const&, DB::ActionsChain&) @ 0x000000001b5cea29
15. /build/src/Planner/PlannerExpressionAnalysis.cpp:559: DB::buildExpressionAnalysisResult(std::shared_ptr<DB::IQueryTreeNode> const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::PlannerContext> const&, DB::PlannerQueryProcessingInfo const&) @ 0x000000001b5cb17b
16. /build/src/Planner/Planner.cpp:1497: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50efb9
17. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50a455
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50765d
19. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0e12
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:39:05.343801 [ 5808 ] {483b66ff-a19a-4ff5-ae7e-99f430863b53} <Error> TCPHandler: Code: 36. DB::Exception: Expression in arrayJoin cannot depend on lambda argument: array(x, 1_UInt8) . (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x000000000a941553
6. /build/src/Planner/PlannerActionsVisitor.cpp:1007: DB::(anonymous namespace)::PlannerActionsVisitorImpl::visitFunction(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001a4a73e0
7. /build/src/Planner/PlannerActionsVisitor.cpp:658: DB::(anonymous namespace)::PlannerActionsVisitorImpl::visitImpl(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001a4a60e9
8. /build/src/Planner/PlannerActionsVisitor.cpp:782: DB::(anonymous namespace)::PlannerActionsVisitorImpl::visitLambda(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001a4a9cce
9. /build/src/Planner/PlannerActionsVisitor.cpp:986: DB::(anonymous namespace)::PlannerActionsVisitorImpl::visitFunction(std::shared_ptr<DB::IQueryTreeNode> const&) @ 0x000000001a4a7030
10. /build/src/Planner/PlannerActionsVisitor.cpp:658: DB::(anonymous namespace)::PlannerActionsVisitorImpl::visitImpl(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001a4a60e9
11. /build/src/Planner/PlannerActionsVisitor.cpp:636: DB::(anonymous namespace)::PlannerActionsVisitorImpl::visit(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001a4a1b08
12. /build/src/Planner/PlannerActionsVisitor.cpp:1043: DB::PlannerActionsVisitor::visit(std::shared_ptr<DB::ActionsDAG>, std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001a4a1818
13. /build/src/Planner/Utils.cpp:242: DB::buildActionsDAGFromExpressionNode(std::shared_ptr<DB::IQueryTreeNode> const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::PlannerContext> const&) @ 0x000000001b5310a5
14. /build/src/Planner/PlannerExpressionAnalysis.cpp:360: DB::(anonymous namespace)::analyzeProjection(DB::QueryNode const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::PlannerContext> const&, DB::ActionsChain&) @ 0x000000001b5cea29
15. /build/src/Planner/PlannerExpressionAnalysis.cpp:559: DB::buildExpressionAnalysisResult(std::shared_ptr<DB::IQueryTreeNode> const&, std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::PlannerContext> const&, DB::PlannerQueryProcessingInfo const&) @ 0x000000001b5cb17b
16. /build/src/Planner/Planner.cpp:1497: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50efb9
17. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50a455
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50765d
19. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0e12
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:39:05.531311 [ 3923 ] {20676f1b-61c8-488b-942c-07ff653b76c8} <Error> DynamicQueryHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=8): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:06.600305 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:06.928315 [ 3552 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/svt/ihzvzhicbplrwmijazxaotdbmwmqk, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 7137f98b-0bc0-45c8-ae9d-3a2dd137165d, upload has finished false.
2025.03.05 22:39:06.929871 [ 3552 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/svt/ihzvzhicbplrwmijazxaotdbmwmqk, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 7137f98b-0bc0-45c8-ae9d-3a2dd137165d, upload has finished false
2025.03.05 22:39:07.000731 [ 3552 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/svt/ihzvzhicbplrwmijazxaotdbmwmqk, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 7137f98b-0bc0-45c8-ae9d-3a2dd137165d, upload has finished false
2025.03.05 22:39:07.139030 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 28 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:07.907207 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:08.440457 [ 5724 ] {ab7ca423-06ef-427a-a544-4463001e70dc} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56644) (comment: 00002_count_visits.sql) (in query: SELECT sum(Sign) FROM test.visits ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:39:08.492157 [ 5724 ] {ab7ca423-06ef-427a-a544-4463001e70dc} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:39:09.803815 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:13.841668 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:14.979810 [ 5808 ] {7e5b98c2-5747-4366-811c-0404ffd7a0b8} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=19, jobs=19). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56648) (comment: 00010_quantiles_segfault.sql) (in query: SELECT URL AS `ym:ah:URL`, sum((NOT DontCountHits AND NOT Refresh)), quantilesTimingIf(0.1, 0.5, 0.9)((DOMCompleteTiming + LoadEventEndTiming), DOMCompleteTiming != -1 AND LoadEventEndTiming != -1) as t FROM remote('127.0.0.{1,2}', test, hits) WHERE (CounterID = 800784) AND (((DontCountHits = 0) OR (IsNotBounce = 1)) AND (URL != '')) GROUP BY `ym:ah:URL` WITH TOTALS HAVING (sum((NOT DontCountHits AND NOT Refresh)) > 0) AND (count() > 0) ORDER BY sum((NOT DontCountHits AND NOT Refresh)) DESC, URL LIMIT 0, 1 ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:15.341596 [ 5808 ] {7e5b98c2-5747-4366-811c-0404ffd7a0b8} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=19, jobs=19). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:15.652516 [ 3780 ] {9312efc1-9642-47c7-9989-fdd9f81c490d} <Error> executeQuery: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:55288). (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:55288) (comment: 00010_quantiles_segfault.sql) (in query: SELECT `__table1`.`URL` AS `ym:ah:URL`, sum((NOT `__table1`.`DontCountHits`) AND (NOT `__table1`.`Refresh`)) AS `sum(and(not(DontCountHits), not(Refresh)))`, quantilesTimingIf(0.1, 0.5, 0.9)(`__table1`.`DOMCompleteTiming` + `__table1`.`LoadEventEndTiming`, (`__table1`.`DOMCompleteTiming` != -1) AND (`__table1`.`LoadEventEndTiming` != -1)) AS `t` FROM `test`.`hits` AS `__table1` WHERE (`__table1`.`CounterID` = 800784) AND (((`__table1`.`DontCountHits` = 0) OR (`__table1`.`IsNotBounce` = 1)) AND (`__table1`.`URL` != '')) GROUP BY `__table1`.`URL` WITH TOTALS HAVING (sum((NOT `__table1`.`DontCountHits`) AND (NOT `__table1`.`Refresh`)) > 0) AND (count() > 0) ORDER BY sum((NOT `__table1`.`DontCountHits`) AND (NOT `__table1`.`Refresh`)) DESC, `__table1`.`URL` ASC LIMIT _CAST(0, 'UInt64'), _CAST(1, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:158: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e75a4
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Server/TCPHandler.cpp:2217: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001d47c18f
9. /build/src/Server/TCPHandler.cpp:1084: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479faa
10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:39:15.818419 [ 3780 ] {9312efc1-9642-47c7-9989-fdd9f81c490d} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:55288). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e7844
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Server/TCPHandler.cpp:2253: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000001d485e55
9. /build/src/Server/TCPHandler.cpp:2330: DB::TCPHandler::sendLogs() @ 0x000000001d47abff
10. /build/src/Server/TCPHandler.cpp:693: DB::TCPHandler::runImpl() @ 0x000000001d4700c2
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:15.833352 [ 3780 ] {9312efc1-9642-47c7-9989-fdd9f81c490d} <Error> TCPHandler: Code: 210. DB::NetException: Connection reset by peer, while writing to socket ([::ffff:127.0.0.2]:9000 -> [::ffff:127.0.0.1]:55288). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:158: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e75a4
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Server/TCPHandler.cpp:2217: DB::TCPHandler::sendData(DB::Block const&) @ 0x000000001d47c18f
9. /build/src/Server/TCPHandler.cpp:1084: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479faa
10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:39:15.852581 [ 3780 ] {9312efc1-9642-47c7-9989-fdd9f81c490d} <Warning> TCPHandler: Client has gone away.
2025.03.05 22:39:16.407464 [ 5819 ] {7d442d03-df2f-4e60-8d37-b8e1afed4bb7} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:49272) (comment: 02246_tsv_csv_best_effort_schema_inference.sh) (in query: select * from file('test_02149.data', 'TSV')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:16.421241 [ 5819 ] {7d442d03-df2f-4e60-8d37-b8e1afed4bb7} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:19.495497 [ 5819 ] {fbeb679f-3a1f-4bc2-9cc9-c1e75c3c6fd9} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:49288) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:19.673753 [ 5819 ] {fbeb679f-3a1f-4bc2-9cc9-c1e75c3c6fd9} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:22.282163 [ 5819 ] {e66b9284-1535-4976-a17f-e833242ded66} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:49306) (comment: 00712_prewhere_with_alias_bug.sql) (in query: insert into prewhere_alias values), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d

2025.03.05 22:39:22.287011 [ 3780 ] {79c20dbe-8deb-4545-bd41-8b0988dc85ac} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:49296) (comment: 00166_explain_estimate.sql) (in query: EXPLAIN ESTIMATE SELECT count() FROM test.hits WHERE CounterID > 29103473;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterExplainQuery.cpp:560: DB::InterpreterExplainQuery::executeImpl() @ 0x000000001b04225f
18. /build/src/Interpreters/InterpreterExplainQuery.cpp:91: DB::InterpreterExplainQuery::execute() @ 0x000000001b03fc2b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:39:22.313693 [ 5819 ] {e66b9284-1535-4976-a17f-e833242ded66} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d

2025.03.05 22:39:22.416170 [ 3780 ] {79c20dbe-8deb-4545-bd41-8b0988dc85ac} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterExplainQuery.cpp:560: DB::InterpreterExplainQuery::executeImpl() @ 0x000000001b04225f
18. /build/src/Interpreters/InterpreterExplainQuery.cpp:91: DB::InterpreterExplainQuery::execute() @ 0x000000001b03fc2b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:39:24.462549 [ 5819 ] {1fe462c2-4925-4718-acec-c2a2f489409f} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=35, jobs=35). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47052) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:39:24.479384 [ 5819 ] {1fe462c2-4925-4718-acec-c2a2f489409f} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=35, jobs=35). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:39:27.175845 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:27.507602 [ 3780 ] {36fad50e-96e2-4e58-9fac-d1eae68500fd} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47062) (comment: 02346_additional_filters_index.sql) (in query: insert into table_1 values ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d

2025.03.05 22:39:27.543755 [ 3780 ] {36fad50e-96e2-4e58-9fac-d1eae68500fd} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d

2025.03.05 22:39:28.130608 [ 5724 ] {edd8230b-a3fd-45ed-a019-bba39898ceb9} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=5): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56692) (comment: 00042_any_left_join.sql) (in query: SELECT EventDate, hits, visits FROM ( SELECT EventDate, count() AS hits FROM test.hits GROUP BY EventDate ) ANY LEFT JOIN ( SELECT StartDate AS EventDate, sum(Sign) AS visits FROM test.visits GROUP BY EventDate ) USING EventDate ORDER BY hits DESC LIMIT 10 SETTINGS joined_subquery_requires_alias = 0;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:39:29.615014 [ 4786 ] {58a67e2b-7d9b-4e8d-a753-ee51c9b5e5bf} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47116) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:39:29.643797 [ 4786 ] {58a67e2b-7d9b-4e8d-a753-ee51c9b5e5bf} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:39:30.195907 [ 5724 ] {edd8230b-a3fd-45ed-a019-bba39898ceb9} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=5): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:39:33.655433 [ 5724 ] {4d52c168-ecf3-4df8-b7bf-dfc5f68e435e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55420) (comment: 02246_tsv_csv_best_effort_schema_inference.sh) (in query: select * from file('test_02149.data', 'TSV')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:33.737268 [ 5724 ] {4d52c168-ecf3-4df8-b7bf-dfc5f68e435e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:34.184438 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {09669507-4528-4e20-b87c-26ebd7ba8c50::202503_1_95_19}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:34.436510 [ 4789 ] {9431d7aa-ea77-4b2b-9d9c-d4bb9d5afa6c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=7). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55436) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:39:34.536442 [ 4789 ] {9431d7aa-ea77-4b2b-9d9c-d4bb9d5afa6c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:39:36.448687 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/bis/rjrchlgwxewqridwpzvybmdksodwk, total size 436207616, count 436207616, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 1820e8cf-3869-45a3-8cd9-7decf2645ff2, upload has finished false.
2025.03.05 22:39:36.450783 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/bis/rjrchlgwxewqridwpzvybmdksodwk, total size 436207616, count 436207616, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 1820e8cf-3869-45a3-8cd9-7decf2645ff2, upload has finished false
2025.03.05 22:39:36.621666 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/bis/rjrchlgwxewqridwpzvybmdksodwk, total size 436207616, count 436207616, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 1820e8cf-3869-45a3-8cd9-7decf2645ff2, upload has finished false
2025.03.05 22:39:36.724126 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 90 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:37.365556 [ 3780 ] {f4a1c37b-7798-4147-8446-9dd2ef16c63a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=35, jobs=35). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47146) (comment: 00146_aggregate_function_uniq.sql) (in query: SELECT RegionID, uniqHLL12(WatchID) AS X FROM remote('127.0.0.{1,2}', test, hits) GROUP BY RegionID HAVING X > 100000 ORDER BY RegionID ASC;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:40.578632 [ 5724 ] {9fc3127f-f60e-4b4e-b93b-f52600802757} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55488) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:39:40.659883 [ 5724 ] {9fc3127f-f60e-4b4e-b93b-f52600802757} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:39:41.571288 [ 3610 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:41.681594 [ 3780 ] {f4a1c37b-7798-4147-8446-9dd2ef16c63a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=35, jobs=35). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:42.216878 [ 8741 ] {5bf84c25-d52c-4313-8493-309752777e49} <Error> executeQuery: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER) (version 24.3.12.76.altinitystable) (from [::1]:55502) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_1 MODIFY COLUMN value0 String SETTINGS mutations_sync = 0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:42.252547 [ 8741 ] {5bf84c25-d52c-4313-8493-309752777e49} <Error> TCPHandler: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:42.399129 [ 8743 ] {56b9bce4-5220-40d8-8f24-3eca8a859bee} <Error> executeQuery: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER) (version 24.3.12.76.altinitystable) (from [::1]:55520) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_1 MODIFY COLUMN value0 String SETTINGS mutations_sync = 0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:42.421558 [ 8743 ] {56b9bce4-5220-40d8-8f24-3eca8a859bee} <Error> TCPHandler: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:42.644376 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:42.782298 [ 9178 ] {1b2ce8d8-28e3-49a8-a04c-6c042bf73e81} <Error> executeQuery: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER) (version 24.3.12.76.altinitystable) (from [::1]:55584) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_3 ADD COLUMN value1 UInt32 DEFAULT 42 SETTINGS replication_alter_partitions_sync=0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:42.824696 [ 9178 ] {1b2ce8d8-28e3-49a8-a04c-6c042bf73e81} <Error> TCPHandler: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:42.950223 [ 8746 ] {663764c6-a436-4095-bfe6-b69452d9d7ef} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55530) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: SELECT * FROM merge(currentDatabase(), 'concurrent_alter_add_drop_steroids_') FORMAT Null), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:42.994349 [ 8746 ] {663764c6-a436-4095-bfe6-b69452d9d7ef} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:43.078122 [ 9182 ] {486b8a38-04ac-4226-baf8-da10bc8191df} <Error> executeQuery: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER) (version 24.3.12.76.altinitystable) (from [::1]:55596) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_2 ADD COLUMN value5 UInt32 DEFAULT 42 SETTINGS replication_alter_partitions_sync=0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:43.104718 [ 9182 ] {486b8a38-04ac-4226-baf8-da10bc8191df} <Error> TCPHandler: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:44.240499 [ 9184 ] {b2d42bff-5278-4df5-b565-0c66f5f7fcdc} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:58946) (comment: 02246_tsv_csv_best_effort_schema_inference.sh) (in query: select * from file('test_02149.data', 'TSV')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:44.275455 [ 9184 ] {b2d42bff-5278-4df5-b565-0c66f5f7fcdc} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:46.330166 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/ppw/hpxdmjowylinybqacyhvrgqokkcmo, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id f5adbbcb-199f-4386-9c36-3adc7408bb09, upload has finished false.
2025.03.05 22:39:46.330917 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/ppw/hpxdmjowylinybqacyhvrgqokkcmo, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id f5adbbcb-199f-4386-9c36-3adc7408bb09, upload has finished false
2025.03.05 22:39:46.453363 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/ppw/hpxdmjowylinybqacyhvrgqokkcmo, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id f5adbbcb-199f-4386-9c36-3adc7408bb09, upload has finished false
2025.03.05 22:39:46.515503 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 21 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:47.572737 [ 5808 ] {365731f1-23cd-43eb-9293-1f7debf97afd} <Error> executeQuery: Code: 10. DB::Exception: Wrong column name. Cannot find column `value1` to drop. Maybe you meant: ['value0']. (NOT_FOUND_COLUMN_IN_BLOCK) (version 24.3.12.76.altinitystable) (from [::1]:58968) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_2 DROP COLUMN value1 SETTINGS replication_alter_partitions_sync=0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5dfe9
6. /build/src/Storages/AlterCommands.cpp:1458: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c2517d1
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:47.572583 [ 8746 ] {3d811985-a2ba-4ee7-ae2d-0a1e849c2c32} <Error> executeQuery: Code: 10. DB::Exception: Wrong column name. Cannot find column `value1` to drop. Maybe you meant: ['value0']. (NOT_FOUND_COLUMN_IN_BLOCK) (version 24.3.12.76.altinitystable) (from [::1]:58984) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_2 DROP COLUMN value1 SETTINGS replication_alter_partitions_sync=0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5dfe9
6. /build/src/Storages/AlterCommands.cpp:1458: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c2517d1
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:47.584829 [ 8746 ] {3d811985-a2ba-4ee7-ae2d-0a1e849c2c32} <Error> TCPHandler: Code: 10. DB::Exception: Wrong column name. Cannot find column `value1` to drop. Maybe you meant: ['value0']. (NOT_FOUND_COLUMN_IN_BLOCK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5dfe9
6. /build/src/Storages/AlterCommands.cpp:1458: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c2517d1
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:47.620924 [ 5808 ] {365731f1-23cd-43eb-9293-1f7debf97afd} <Error> TCPHandler: Code: 10. DB::Exception: Wrong column name. Cannot find column `value1` to drop. Maybe you meant: ['value0']. (NOT_FOUND_COLUMN_IN_BLOCK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5dfe9
6. /build/src/Storages/AlterCommands.cpp:1458: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c2517d1
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:47.900800 [ 3780 ] {9cde5979-f0fb-490b-9297-320aef50f837} <Error> executeQuery: Code: 10. DB::Exception: Wrong column name. Cannot find column `value2` to drop. Maybe you meant: ['value0']. (NOT_FOUND_COLUMN_IN_BLOCK) (version 24.3.12.76.altinitystable) (from [::1]:58994) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_3 DROP COLUMN value2 SETTINGS replication_alter_partitions_sync=0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5dfe9
6. /build/src/Storages/AlterCommands.cpp:1458: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c2517d1
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:48.002941 [ 3780 ] {9cde5979-f0fb-490b-9297-320aef50f837} <Error> TCPHandler: Code: 10. DB::Exception: Wrong column name. Cannot find column `value2` to drop. Maybe you meant: ['value0']. (NOT_FOUND_COLUMN_IN_BLOCK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5dfe9
6. /build/src/Storages/AlterCommands.cpp:1458: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c2517d1
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:49.664339 [ 4789 ] {ca3848bf-2fd2-46b8-b336-6e486e00a289} <Error> executeQuery: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER) (version 24.3.12.76.altinitystable) (from [::1]:59016) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_1 MODIFY COLUMN value0 UInt8 SETTINGS mutations_sync = 0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:49.692136 [ 4789 ] {ca3848bf-2fd2-46b8-b336-6e486e00a289} <Error> TCPHandler: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:49.737297 [ 8741 ] {0d0c72bf-fa46-425e-999d-dba01fb3f995} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59040) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: SELECT * FROM merge(currentDatabase(), 'concurrent_alter_add_drop_steroids_') FORMAT Null), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Storages/StorageMerge.cpp:1128: DB::ReadFromMerge::buildPipeline(DB::ReadFromMerge::ChildPlan&, DB::QueryProcessingStage::Enum) const @ 0x000000001c4443f0
18. /build/src/Storages/StorageMerge.cpp:451: DB::ReadFromMerge::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001c4439b6
19. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
20. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
23. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
24. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
25. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
26. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
27. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
28. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
29. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
30. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
31. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e

2025.03.05 22:39:49.788471 [ 8741 ] {0d0c72bf-fa46-425e-999d-dba01fb3f995} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Storages/StorageMerge.cpp:1128: DB::ReadFromMerge::buildPipeline(DB::ReadFromMerge::ChildPlan&, DB::QueryProcessingStage::Enum) const @ 0x000000001c4443f0
18. /build/src/Storages/StorageMerge.cpp:451: DB::ReadFromMerge::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001c4439b6
19. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
20. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
23. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
24. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
25. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
26. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
27. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
28. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
29. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
30. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
31. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e

2025.03.05 22:39:50.683046 [ 3780 ] {70c22f7e-8333-42ea-9963-b92105970d80} <Error> executeQuery: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER) (version 24.3.12.76.altinitystable) (from [::1]:59026) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_1 MODIFY COLUMN value0 UInt8 SETTINGS mutations_sync = 0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:50.685667 [ 9183 ] {1d140e3d-67fc-4e26-84ad-d986ab84ad84} <Error> executeQuery: Code: 36. DB::Exception: From array size and to array size mismatch: In scope SELECT bitmapTransform(arrayReduce('groupBitmapState', [1]), [1, 2], [1, 2, 3]). (BAD_ARGUMENTS) (version 24.3.12.76.altinitystable) (from [::1]:59084) (comment: 02430_bitmap_transform_exception_code.sql) (in query: SELECT bitmapTransform(arrayReduce('groupBitmapState', [1]), [1, 2], [1, 2, 3]);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Functions/FunctionsBitmap.h:649: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::FunctionBitmapTransform::executeIntType<char8_t>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, unsigned long) const @ 0x000000000a9d2ce3
7. /build/src/Functions/FunctionsBitmap.h:540: DB::FunctionBitmapTransform::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a9d1ac0
8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:39:50.974428 [ 9183 ] {1d140e3d-67fc-4e26-84ad-d986ab84ad84} <Error> TCPHandler: Code: 36. DB::Exception: From array size and to array size mismatch: In scope SELECT bitmapTransform(arrayReduce('groupBitmapState', [1]), [1, 2], [1, 2, 3]). (BAD_ARGUMENTS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Functions/FunctionsBitmap.h:649: COW<DB::IColumn>::immutable_ptr<DB::IColumn> DB::FunctionBitmapTransform::executeIntType<char8_t>(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, unsigned long) const @ 0x000000000a9d2ce3
7. /build/src/Functions/FunctionsBitmap.h:540: DB::FunctionBitmapTransform::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a9d1ac0
8. /build/src/Functions/IFunction.h:443: DB::IFunction::executeImplDryRun(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000a8ee099
9. /build/src/Functions/IFunctionAdaptors.h:26: DB::FunctionToExecutableFunctionAdaptor::executeDryRunImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x000000000af697ad
10. /build/src/Functions/IFunction.cpp:277: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061506
11. /build/src/Functions/IFunction.cpp:191: DB::IExecutableFunction::defaultImplementationForConstantArguments(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019061083
12. /build/src/Functions/IFunction.cpp:269: DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190613e3
13. /build/src/Functions/IFunction.cpp:336: DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x0000000019062626
14. /build/src/Functions/IFunction.cpp:411: DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x00000000190636b5
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6185: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0bc989
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:39:50.974498 [ 3780 ] {70c22f7e-8333-42ea-9963-b92105970d80} <Error> TCPHandler: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:51.010147 [ 9182 ] {2525d1bb-b95c-49f6-97c4-bde51e510782} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59078) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: INSERT INTO concurrent_alter_add_drop_steroids_2 VALUES), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:320: DB::ReplicatedMergeTreeSinkImpl<false>::consume(DB::Chunk) @ 0x000000001d0a2220
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6

2025.03.05 22:39:51.060261 [ 9182 ] {2525d1bb-b95c-49f6-97c4-bde51e510782} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/ReplicatedMergeTreeSink.cpp:320: DB::ReplicatedMergeTreeSinkImpl<false>::consume(DB::Chunk) @ 0x000000001d0a2220
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6

2025.03.05 22:39:51.375735 [ 3828 ] {bc4f1882-4bff-4660-b4fa-475c3fcfae7c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=10): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:58986) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: SELECT * FROM merge(currentDatabase(), 'concurrent_alter_add_drop_steroids_') FORMAT Null), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:39:52.040424 [ 3828 ] {bc4f1882-4bff-4660-b4fa-475c3fcfae7c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=10): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:39:52.994523 [ 9182 ] {af38145e-ba48-4445-a2e6-661c72839687} <Error> executeQuery: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER) (version 24.3.12.76.altinitystable) (from [::1]:59132) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_1 ADD COLUMN value4 UInt32 DEFAULT 42 SETTINGS replication_alter_partitions_sync=0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:53.026512 [ 9182 ] {af38145e-ba48-4445-a2e6-661c72839687} <Error> TCPHandler: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:53.574556 [ 8742 ] {07eb8988-c693-48c0-9931-9f31679fa400} <Error> executeQuery: Code: 15. DB::Exception: Cannot add column `value2`: column with this name already exists. (DUPLICATE_COLUMN) (version 24.3.12.76.altinitystable) (from [::1]:36008) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_2 ADD COLUMN value2 UInt32 DEFAULT 42 SETTINGS replication_alter_partitions_sync=0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Storages/AlterCommands.cpp:1279: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c24ea40
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:53.577432 [ 9183 ] {66f51235-b9c6-46ba-a11d-a8436bfdf294} <Error> executeQuery: Code: 15. DB::Exception: Cannot add column `value2`: column with this name already exists. (DUPLICATE_COLUMN) (version 24.3.12.76.altinitystable) (from [::1]:36002) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_1 ADD COLUMN value2 UInt32 DEFAULT 42 SETTINGS replication_alter_partitions_sync=0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Storages/AlterCommands.cpp:1279: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c24ea40
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:53.587733 [ 8742 ] {07eb8988-c693-48c0-9931-9f31679fa400} <Error> TCPHandler: Code: 15. DB::Exception: Cannot add column `value2`: column with this name already exists. (DUPLICATE_COLUMN), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Storages/AlterCommands.cpp:1279: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c24ea40
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:53.672665 [ 9183 ] {66f51235-b9c6-46ba-a11d-a8436bfdf294} <Error> TCPHandler: Code: 15. DB::Exception: Cannot add column `value2`: column with this name already exists. (DUPLICATE_COLUMN), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Storages/AlterCommands.cpp:1279: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c24ea40
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:54.780168 [ 3554 ] {} <Error> 86d8a18b-f46f-4d5d-aa87-dc0348cdf6d3::all_0_4_1_1 (MergeFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:43: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce46f4
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergeFromLogEntryTask.h:36: DB::MergeFromLogEntryTask::executeInnerTask() @ 0x000000001cb5b984
29. /build/src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:208: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x000000001cfe8d99
30. /build/src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:47: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x000000001cfe6f80
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:54.788784 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {86d8a18b-f46f-4d5d-aa87-dc0348cdf6d3::all_0_4_1_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:43: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce46f4
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergeFromLogEntryTask.h:36: DB::MergeFromLogEntryTask::executeInnerTask() @ 0x000000001cb5b984
29. /build/src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:208: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x000000001cfe8d99
30. /build/src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:47: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x000000001cfe6f80
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:56.973853 [ 9181 ] {e1bbfbe7-98ef-4e3e-b80d-e14ffc1d732f} <Error> executeQuery: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER) (version 24.3.12.76.altinitystable) (from [::1]:36092) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_1 MODIFY COLUMN value0 String SETTINGS mutations_sync = 0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:56.986634 [ 9181 ] {e1bbfbe7-98ef-4e3e-b80d-e14ffc1d732f} <Error> TCPHandler: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:57.058997 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/bei/hszpugvfmywnwiknkhnmoinjzfith, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id bae7a86a-47bd-4674-8d48-e48b864d473e, upload has finished false.
2025.03.05 22:39:57.068378 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/bei/hszpugvfmywnwiknkhnmoinjzfith, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id bae7a86a-47bd-4674-8d48-e48b864d473e, upload has finished false
2025.03.05 22:39:57.124963 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/bei/hszpugvfmywnwiknkhnmoinjzfith, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id bae7a86a-47bd-4674-8d48-e48b864d473e, upload has finished false
2025.03.05 22:39:57.181945 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 22 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:57.882850 [ 9181 ] {17eff816-c1a6-4006-847b-61496c243f24} <Error> executeQuery: Code: 10. DB::Exception: Wrong column name. Cannot find column `value5` to drop. Maybe you meant: ['value0']. (NOT_FOUND_COLUMN_IN_BLOCK) (version 24.3.12.76.altinitystable) (from [::1]:36106) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_1 DROP COLUMN value5 SETTINGS replication_alter_partitions_sync=0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5dfe9
6. /build/src/Storages/AlterCommands.cpp:1458: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c2517d1
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:57.912847 [ 9181 ] {17eff816-c1a6-4006-847b-61496c243f24} <Error> TCPHandler: Code: 10. DB::Exception: Wrong column name. Cannot find column `value5` to drop. Maybe you meant: ['value0']. (NOT_FOUND_COLUMN_IN_BLOCK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5dfe9
6. /build/src/Storages/AlterCommands.cpp:1458: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c2517d1
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:58.211620 [ 9184 ] {64382c99-8b01-4d2f-8230-b0590f7506b9} <Error> executeQuery: Code: 10. DB::Exception: Wrong column name. Cannot find column `value1` to drop. Maybe you meant: ['value0']. (NOT_FOUND_COLUMN_IN_BLOCK) (version 24.3.12.76.altinitystable) (from [::1]:36118) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_2 DROP COLUMN value1 SETTINGS replication_alter_partitions_sync=0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5dfe9
6. /build/src/Storages/AlterCommands.cpp:1458: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c2517d1
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:58.228552 [ 9184 ] {64382c99-8b01-4d2f-8230-b0590f7506b9} <Error> TCPHandler: Code: 10. DB::Exception: Wrong column name. Cannot find column `value1` to drop. Maybe you meant: ['value0']. (NOT_FOUND_COLUMN_IN_BLOCK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5dfe9
6. /build/src/Storages/AlterCommands.cpp:1458: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c2517d1
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:58.480823 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:39:59.090384 [ 5808 ] {244940ed-d1a9-4b11-a500-52ca50e01797} <Error> executeQuery: Code: 10. DB::Exception: Wrong column name. Cannot find column `value4` to drop. Maybe you meant: ['value0']. (NOT_FOUND_COLUMN_IN_BLOCK) (version 24.3.12.76.altinitystable) (from [::1]:36176) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_1 DROP COLUMN value4 SETTINGS replication_alter_partitions_sync=0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5dfe9
6. /build/src/Storages/AlterCommands.cpp:1458: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c2517d1
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:59.104312 [ 5808 ] {244940ed-d1a9-4b11-a500-52ca50e01797} <Error> TCPHandler: Code: 10. DB::Exception: Wrong column name. Cannot find column `value4` to drop. Maybe you meant: ['value0']. (NOT_FOUND_COLUMN_IN_BLOCK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:66: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000af5dfe9
6. /build/src/Storages/AlterCommands.cpp:1458: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c2517d1
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:39:59.130068 [ 8746 ] {27fd8437-d5ce-4c00-b068-e1acc5f0be12} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36142) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:39:59.176205 [ 8746 ] {27fd8437-d5ce-4c00-b068-e1acc5f0be12} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:00.018556 [ 9178 ] {c9d20ad5-42f6-468f-8ecb-67d77de91d12} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=12): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36102) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: SELECT * FROM merge(currentDatabase(), 'concurrent_alter_add_drop_steroids_') FORMAT Null), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:40:00.662072 [ 9178 ] {c9d20ad5-42f6-468f-8ecb-67d77de91d12} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=12): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:40:00.904683 [ 8742 ] {727f5588-3458-424a-91f4-c1ed4b64e49a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=5): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36086) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: SELECT * FROM merge(currentDatabase(), 'concurrent_alter_add_drop_steroids_') FORMAT Null), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:40:00.940856 [ 9183 ] {4d47e069-f3b2-47f7-a6c7-a0623f888834} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36068) (comment: 02552_sparse_columns_intersect.sql) (in query: INSERT INTO t_sparse_intersect SELECT number, number FROM numbers(1000);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d511b1d
13. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d5119aa
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d511939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d51189d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'()::operator()() @ 0x000000001d5117a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5116f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5116d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5116a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:00.997573 [ 9183 ] {4d47e069-f3b2-47f7-a6c7-a0623f888834} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d511b1d
13. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d5119aa
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d511939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d51189d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'()::operator()() @ 0x000000001d5117a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5116f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5116d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5116a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:02.273329 [ 8742 ] {727f5588-3458-424a-91f4-c1ed4b64e49a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=5): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:40:03.541554 [ 9184 ] {94d04141-6cda-435a-ba7d-b1e6753ac056} <Error> executeQuery: Code: 15. DB::Exception: Cannot add column `value2`: column with this name already exists. (DUPLICATE_COLUMN) (version 24.3.12.76.altinitystable) (from [::1]:34360) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_2 ADD COLUMN value2 UInt32 DEFAULT 42 SETTINGS replication_alter_partitions_sync=0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Storages/AlterCommands.cpp:1279: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c24ea40
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:40:03.556139 [ 9184 ] {94d04141-6cda-435a-ba7d-b1e6753ac056} <Error> TCPHandler: Code: 15. DB::Exception: Cannot add column `value2`: column with this name already exists. (DUPLICATE_COLUMN), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x000000000a8eebf3
6. /build/src/Storages/AlterCommands.cpp:1279: DB::AlterCommands::validate(std::shared_ptr<DB::IStorage> const&, std::shared_ptr<DB::Context const>) const @ 0x000000001c24ea40
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:198: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff8f52
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:40:03.608895 [ 8748 ] {0db537dd-b43b-4e3c-84eb-47af91a31535} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.87 million. (TOO_MANY_ROWS) (version 24.3.12.76.altinitystable) (from [::1]:36238) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT 1 = (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec0f28
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec0a4c
7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000019ec0d99
8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:258: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001dd4f663
9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1971: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd6139e
10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:2110: DB::(anonymous namespace)::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0be708
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6524: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a170d
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5542: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0b67f8
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
24. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
25. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
27. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d

2025.03.05 22:40:03.646038 [ 8748 ] {0db537dd-b43b-4e3c-84eb-47af91a31535} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.87 million. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec0f28
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec0a4c
7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000019ec0d99
8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:258: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001dd4f663
9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1971: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd6139e
10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:2110: DB::(anonymous namespace)::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0be708
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6524: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a170d
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5542: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0b67f8
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6901: DB::(anonymous namespace)::QueryAnalyzer::resolveProjectionExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0a9fc7
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8173: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09bb43
22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
24. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
25. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
27. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d

2025.03.05 22:40:03.712095 [ 4786 ] {09331ca6-5ac1-4161-ac50-30ae55573663} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55444) (comment: 00030_array_enumerate_uniq.sql) (in query: SELECT max(arrayJoin(arrayEnumerateUniq(arrayMap(x -> intDiv(x, 10), URLCategories)))) FROM test.hits ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:03.915955 [ 8746 ] {6f7e4fb0-a945-4341-9904-fbac4227662d} <Error> executeQuery: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER) (version 24.3.12.76.altinitystable) (from [::1]:34342) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_1 MODIFY COLUMN value0 UInt8 SETTINGS mutations_sync = 0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:40:03.962994 [ 8746 ] {6f7e4fb0-a945-4341-9904-fbac4227662d} <Error> TCPHandler: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:40:04.324078 [ 4786 ] {09331ca6-5ac1-4161-ac50-30ae55573663} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:04.376755 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 11 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:04.558840 [ 3540 ] {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key s3/fax/wkpbrwdftjuilmddyvsafauisyeod, total size 122843301, count 122843301, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id da291a83-d876-4a94-8597-89cfd9c7d098, upload has finished false.
2025.03.05 22:40:04.559574 [ 3540 ] {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key s3/fax/wkpbrwdftjuilmddyvsafauisyeod, total size 122843301, count 122843301, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id da291a83-d876-4a94-8597-89cfd9c7d098, upload has finished false
2025.03.05 22:40:04.629920 [ 3540 ] {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key s3/fax/wkpbrwdftjuilmddyvsafauisyeod, total size 122843301, count 122843301, hidden_size 0, offset 0, with pool: true, prefinalized true, finalized false, upload id da291a83-d876-4a94-8597-89cfd9c7d098, upload has finished false
2025.03.05 22:40:05.025040 [ 4789 ] {6cd468c7-8cf9-47e7-bdbc-3ae17c9e0cc4} <Error> executeQuery: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER) (version 24.3.12.76.altinitystable) (from [::1]:34370) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_3 ADD COLUMN value4 UInt32 DEFAULT 42 SETTINGS replication_alter_partitions_sync=0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:40:05.025382 [ 8741 ] {e18a31bb-7de6-49f3-90fe-e44cb1996ea5} <Error> executeQuery: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER) (version 24.3.12.76.altinitystable) (from [::1]:34380) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_1 ADD COLUMN value4 UInt32 DEFAULT 42 SETTINGS replication_alter_partitions_sync=0), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:40:05.033735 [ 4789 ] {6cd468c7-8cf9-47e7-bdbc-3ae17c9e0cc4} <Error> TCPHandler: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:40:05.028989 [ 8741 ] {e18a31bb-7de6-49f3-90fe-e44cb1996ea5} <Error> TCPHandler: Code: 517. DB::Exception: Metadata on replica is not up to date with common metadata in Zookeeper. It means that this replica still not applied some of previous alters. Probably too many alters executing concurrently (highly not recommended). You can retry this error. (CANNOT_ASSIGN_ALTER), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/StorageReplicatedMergeTree.cpp:6265: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c552114
7. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
8. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
9. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
10. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
11. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
12. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
13. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
14. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
15. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
16. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
17. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
18. ? @ 0x00007f7a996d8ac3
19. ? @ 0x00007f7a9976a850

2025.03.05 22:40:05.026729 [ 8748 ] {90b137e7-aa97-4d82-a747-e5b0a7c23c42} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.87 million. (TOO_MANY_ROWS) (version 24.3.12.76.altinitystable) (from [::1]:36238) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT 1 IN (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec0f28
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec0a4c
7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000019ec0d99
8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:258: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001dd4f663
9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1971: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd6139e
10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
14. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
15. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
16. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
17. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
18. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
19. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
20. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
21. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
22. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
23. ? @ 0x00007f7a996d8ac3
24. ? @ 0x00007f7a9976a850

2025.03.05 22:40:05.068649 [ 8748 ] {90b137e7-aa97-4d82-a747-e5b0a7c23c42} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.87 million. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec0f28
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec0a4c
7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000019ec0d99
8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:258: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001dd4f663
9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1971: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd6139e
10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
14. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
15. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
16. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
17. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
18. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
19. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
20. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
21. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
22. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
23. ? @ 0x00007f7a996d8ac3
24. ? @ 0x00007f7a9976a850

2025.03.05 22:40:05.023950 [ 9177 ] {6b1d13a1-511e-437e-81b0-c35ecb37aee1} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=19, jobs=19). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34384) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:40:05.261158 [ 9177 ] {6b1d13a1-511e-437e-81b0-c35ecb37aee1} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=19, jobs=19). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:40:05.301617 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column StartURL): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_3_3_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 32 with max_rows_to_read = 6608): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:06.663550 [ 3780 ] {06951b71-997a-4590-afe7-1a459fead109} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34412) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: SELECT * FROM merge(currentDatabase(), 'concurrent_alter_add_drop_steroids_') FORMAT Null), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Storages/StorageMerge.cpp:1128: DB::ReadFromMerge::buildPipeline(DB::ReadFromMerge::ChildPlan&, DB::QueryProcessingStage::Enum) const @ 0x000000001c4443f0
18. /build/src/Storages/StorageMerge.cpp:451: DB::ReadFromMerge::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001c4439b6
19. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
20. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
23. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
24. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
25. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
26. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
27. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
28. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
29. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
30. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
31. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e

2025.03.05 22:40:06.695876 [ 3780 ] {06951b71-997a-4590-afe7-1a459fead109} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Storages/StorageMerge.cpp:1128: DB::ReadFromMerge::buildPipeline(DB::ReadFromMerge::ChildPlan&, DB::QueryProcessingStage::Enum) const @ 0x000000001c4443f0
18. /build/src/Storages/StorageMerge.cpp:451: DB::ReadFromMerge::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001c4439b6
19. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
20. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
21. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
22. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
23. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
24. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
25. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
26. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
27. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
28. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
29. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
30. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
31. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e

2025.03.05 22:40:08.517937 [ 9178 ] {87e9ac0f-9ada-4f72-956c-3bcd4a3a37d3} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34434) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: SELECT * FROM merge(currentDatabase(), 'concurrent_alter_add_drop_steroids_') FORMAT Null), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:08.523100 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:08.852397 [ 9178 ] {87e9ac0f-9ada-4f72-956c-3bcd4a3a37d3} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::1]:9000 -> [::1]:34434). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e7844
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Server/TCPHandler.cpp:2253: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000001d485e55
9. /build/src/Server/TCPHandler.cpp:2330: DB::TCPHandler::sendLogs() @ 0x000000001d47abff
10. /build/src/Server/TCPHandler.cpp:693: DB::TCPHandler::runImpl() @ 0x000000001d4700c2
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:08.880862 [ 9178 ] {87e9ac0f-9ada-4f72-956c-3bcd4a3a37d3} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:08.902933 [ 9178 ] {87e9ac0f-9ada-4f72-956c-3bcd4a3a37d3} <Warning> TCPHandler: Client has gone away.
2025.03.05 22:40:11.958313 [ 8746 ] {01ab7514-1c37-425c-bff4-0825b5c7e0f8} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=19, jobs=19). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34514) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: select count() from system.columns where table='concurrent_alter_add_drop_steroids_1' and database='test_iqnfimmp'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:40:12.015948 [ 8746 ] {01ab7514-1c37-425c-bff4-0825b5c7e0f8} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=19, jobs=19). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:40:12.590557 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/sby/nmnabddtprihrdeumqwbzlykfegju, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b3193865-60d2-4561-8a8e-1c49ec624ca8, upload has finished false.
2025.03.05 22:40:12.597430 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/sby/nmnabddtprihrdeumqwbzlykfegju, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b3193865-60d2-4561-8a8e-1c49ec624ca8, upload has finished false
2025.03.05 22:40:12.652593 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/sby/nmnabddtprihrdeumqwbzlykfegju, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b3193865-60d2-4561-8a8e-1c49ec624ca8, upload has finished false
2025.03.05 22:40:12.733276 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 19 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:14.696280 [ 5808 ] {ad9967d5-e94d-44f4-a592-e5b75e3605b2} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43388) (comment: 02246_tsv_csv_best_effort_schema_inference.sh) (in query: select * from file('test_02149.data', 'TSV')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:14.737218 [ 5808 ] {ad9967d5-e94d-44f4-a592-e5b75e3605b2} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:16.572852 [ 5808 ] {296f19b7-d739-4d76-a5f9-7bbc9abe9a32} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=19, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43404) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: select count() from system.columns where table='concurrent_alter_add_drop_steroids_2' and database='test_iqnfimmp'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:16.732435 [ 5808 ] {296f19b7-d739-4d76-a5f9-7bbc9abe9a32} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=19, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:20.926786 [ 8748 ] {bff1a595-6715-42b3-8c34-98b81738bdfd} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 15.00 million, current rows: 15.14 million: While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (TOO_MANY_ROWS) (version 24.3.12.76.altinitystable) (from [::1]:36238) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() IN (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID)) FROM test.hits WHERE NOT ignore(AdvEngineID);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec0f28
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec0a4c
7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e92e84
8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d532c71
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d532720
10. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514ca1
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:40:21.838021 [ 8748 ] {bff1a595-6715-42b3-8c34-98b81738bdfd} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows or bytes to read exceeded, max rows: 15.00 million, current rows: 15.14 million: While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec0f28
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec0a4c
7. /build/src/QueryPipeline/ReadProgressCallback.cpp:109: DB::ReadProgressCallback::onProgress(unsigned long, unsigned long, std::list<DB::StorageLimits, std::allocator<DB::StorageLimits>> const&) @ 0x0000000019e92e84
8. /build/src/Processors/Executors/ExecutionThreadContext.cpp:62: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d532c71
9. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d532720
10. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514ca1
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:40:21.870471 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:22.844886 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:23.356319 [ 8741 ] {6d5d8313-57ac-47cc-a81c-825bf26983f7} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43112) (comment: 02246_tsv_csv_best_effort_schema_inference.sh) (in query: select * from file('test_02149.data', 'TSV')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:40:23.417378 [ 8741 ] {6d5d8313-57ac-47cc-a81c-825bf26983f7} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:40:24.330725 [ 8748 ] {3ec56a89-5afa-4b8d-a49a-821173d482be} <Error> executeQuery: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.87 million. (TOO_MANY_ROWS) (version 24.3.12.76.altinitystable) (from [::1]:36238) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() FROM test.hits WHERE CounterID > (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec0f28
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec0a4c
7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000019ec0d99
8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:258: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001dd4f663
9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1971: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd6139e
10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:2110: DB::(anonymous namespace)::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0be708
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6524: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a170d
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5542: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0b67f8
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8198: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09be77
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:40:24.360355 [ 8748 ] {3ec56a89-5afa-4b8d-a49a-821173d482be} <Error> TCPHandler: Code: 158. DB::Exception: Limit for rows (controlled by 'max_rows_to_read' setting) exceeded, max rows: 1.00 million, current rows: 8.87 million. (TOO_MANY_ROWS), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*&, String, String>(int, FormatStringHelperImpl<std::type_identity<char const*&>::type, std::type_identity<String>::type, std::type_identity<String>::type>, char const*&, String&&, String&&) @ 0x0000000019ec0f28
6. /build/src/QueryPipeline/SizeLimits.cpp:25: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int, int) const @ 0x0000000019ec0a4c
7. /build/src/QueryPipeline/SizeLimits.cpp:65: DB::SizeLimits::check(unsigned long, unsigned long, char const*, int) const @ 0x0000000019ec0d99
8. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:258: DB::ReadFromMergeTree::AnalysisResult::checkLimits(DB::Settings const&, DB::SelectQueryInfo const&) const @ 0x000000001dd4f663
9. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1971: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd6139e
10. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
11. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
12. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
13. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
14. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:2110: DB::(anonymous namespace)::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0be708
15. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6524: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a170d
16. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
17. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5542: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0b67f8
18. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8198: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09be77
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
22. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
23. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
24. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
25. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
26. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001b507ffd
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001b507f9d
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001b507f5d
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001b507f25
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001b42791e

2025.03.05 22:40:25.609946 [ 8746 ] {bc14d8f3-96e0-49f2-97da-1a404cf36ea4} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=38, jobs=38). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43122) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:26.069593 [ 8746 ] {bc14d8f3-96e0-49f2-97da-1a404cf36ea4} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=38, jobs=38). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:26.086223 [ 8748 ] {a6b52509-092b-4d91-8847-28684057fecb} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36238) (comment: 00175_counting_resources_in_subqueries.sql) (in query: SELECT count() FROM test.hits WHERE CounterID < (SELECT count() FROM test.hits WHERE NOT ignore(AdvEngineID));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:2110: DB::(anonymous namespace)::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0be708
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6524: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a170d
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5542: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0b67f8
23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8198: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09be77
25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
26. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
27. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
29. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
30. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
31. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c

2025.03.05 22:40:26.099527 [ 8748 ] {a6b52509-092b-4d91-8847-28684057fecb} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:2110: DB::(anonymous namespace)::QueryAnalyzer::evaluateScalarSubqueryIfNeeded(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0be708
20. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6524: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a170d
21. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6640: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNodeList(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b09f821
22. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:5542: DB::(anonymous namespace)::QueryAnalyzer::resolveFunction(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b0b67f8
23. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:6487: DB::(anonymous namespace)::QueryAnalyzer::resolveExpressionNode(std::shared_ptr<DB::IQueryTreeNode>&, DB::(anonymous namespace)::IdentifierResolveScope&, bool, bool) @ 0x000000001b0a12ea
24. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8198: DB::(anonymous namespace)::QueryAnalyzer::resolveQuery(std::shared_ptr<DB::IQueryTreeNode> const&, DB::(anonymous namespace)::IdentifierResolveScope&) @ 0x000000001b09be77
25. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:1150: DB::(anonymous namespace)::QueryAnalyzer::resolve(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::IQueryTreeNode> const&, std::shared_ptr<DB::Context const>) @ 0x000000001b099d74
26. /build/src/Analyzer/Passes/QueryAnalysisPass.cpp:8408: DB::QueryAnalysisPass::run(std::shared_ptr<DB::IQueryTreeNode>&, std::shared_ptr<DB::Context const>) @ 0x000000001b099a33
27. /build/src/Analyzer/QueryTreePassManager.cpp:186: DB::QueryTreePassManager::run(std::shared_ptr<DB::IQueryTreeNode>) @ 0x000000001b08b1a6
28. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:142: DB::(anonymous namespace)::buildQueryTreeAndRunPasses(std::shared_ptr<DB::IAST> const&, DB::SelectQueryOptions const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IStorage> const&) @ 0x000000001b506bac
29. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:160: DB::InterpreterSelectQueryAnalyzer::InterpreterSelectQueryAnalyzer(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const> const&, DB::SelectQueryOptions const&, std::vector<String, std::allocator<String>> const&) @ 0x000000001b5057e6
30. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::InterpreterSelectQueryAnalyzer>::__unique_single std::make_unique[abi:v15000]<DB::InterpreterSelectQueryAnalyzer, std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&>(std::shared_ptr<DB::IAST>&, std::shared_ptr<DB::Context> const&, DB::SelectQueryOptions const&) @ 0x000000001b508bb7
31. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:270: DB::registerInterpreterSelectQueryAnalyzer(DB::InterpreterFactory&)::$_0::operator()(DB::InterpreterFactory::Arguments const&) const @ 0x000000001b50804c

2025.03.05 22:40:29.556889 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/vts/dykuyzmidpiehxnrbleexpqovbpln, total size 184549376, count 184549376, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id af87d072-b873-48cf-a841-d375b874d546, upload has finished false.
2025.03.05 22:40:29.567064 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/vts/dykuyzmidpiehxnrbleexpqovbpln, total size 184549376, count 184549376, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id af87d072-b873-48cf-a841-d375b874d546, upload has finished false
2025.03.05 22:40:29.690902 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/vts/dykuyzmidpiehxnrbleexpqovbpln, total size 184549376, count 184549376, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id af87d072-b873-48cf-a841-d375b874d546, upload has finished false
2025.03.05 22:40:29.902303 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 41 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:30.066289 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:30.509345 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:30.860428 [ 5808 ] {ec6f4ec4-8aeb-4410-97fa-04d91e3dae3c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=28, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43166) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: select count() from system.columns where table='concurrent_alter_add_drop_steroids_2' and database='test_iqnfimmp'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:30.876154 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:30.943657 [ 5808 ] {ec6f4ec4-8aeb-4410-97fa-04d91e3dae3c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=28, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:31.160905 [ 3780 ] {36a4af75-815b-402a-91f9-72927f90cca8} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43170) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:31.214844 [ 3780 ] {36a4af75-815b-402a-91f9-72927f90cca8} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:31.394217 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:33.461134 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38ea0
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:35.771404 [ 8746 ] {d1420e8d-3dc0-46d2-a019-3c750cefde39} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=30, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37508) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: select count() from system.columns where table='concurrent_alter_add_drop_steroids_3' and database='test_iqnfimmp'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:35.798140 [ 8746 ] {d1420e8d-3dc0-46d2-a019-3c750cefde39} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=30, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:36.401374 [ 5808 ] {531a140c-297d-4674-9870-ff86c8d0ccda} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37516) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:36.531848 [ 5808 ] {531a140c-297d-4674-9870-ff86c8d0ccda} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:40.048687 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/fjd/nwliwolbkcfoianloinucyetmezbo, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2383a5c6-8674-48a7-821d-5b95fdcd7515, upload has finished false.
2025.03.05 22:40:40.049444 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/fjd/nwliwolbkcfoianloinucyetmezbo, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2383a5c6-8674-48a7-821d-5b95fdcd7515, upload has finished false
2025.03.05 22:40:40.095348 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/fjd/nwliwolbkcfoianloinucyetmezbo, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2383a5c6-8674-48a7-821d-5b95fdcd7515, upload has finished false
2025.03.05 22:40:40.182048 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 22 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:41.185656 [ 9181 ] {b1043798-2d5a-4381-bfba-25f289555bf7} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=42, jobs=42). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37600) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: select count() from system.columns where table='concurrent_alter_add_drop_steroids_1' and database='test_iqnfimmp'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:40:41.239947 [ 9181 ] {b1043798-2d5a-4381-bfba-25f289555bf7} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=42, jobs=42). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:40:41.259024 [ 9183 ] {da2ddc4c-c8ce-478a-ad9c-3df07f5d1c45} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37602) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:40:41.307372 [ 9183 ] {da2ddc4c-c8ce-478a-ad9c-3df07f5d1c45} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:40:45.281508 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 9 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:45.647073 [ 9181 ] {ec07a468-a6bc-416d-81a4-b7db2272e55c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59284) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: select count() from system.columns where table='concurrent_alter_add_drop_steroids_2' and database='test_iqnfimmp'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:45.704893 [ 9181 ] {ec07a468-a6bc-416d-81a4-b7db2272e55c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:46.100551 [ 9183 ] {d47a68ee-ddbc-425d-a541-82c189a16e34} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59298) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:46.135787 [ 9183 ] {d47a68ee-ddbc-425d-a541-82c189a16e34} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:48.341424 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:51.163439 [ 9181 ] {bb444a6c-2ff8-41b8-8e42-1554b810585a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=21, jobs=14). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59350) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:51.200974 [ 9181 ] {bb444a6c-2ff8-41b8-8e42-1554b810585a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=21, jobs=14). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:40:53.815545 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 12 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:55.806118 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:56.500140 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_107_137_6}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:40:59.783036 [ 3550 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=2): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 6 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:00.820318 [ 9178 ] {b374f8c2-8210-4c87-a8e8-c376d9c899b2} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36186) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: select count() from system.columns where table='concurrent_alter_add_drop_steroids_2' and database='test_iqnfimmp'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:00.937788 [ 9178 ] {b374f8c2-8210-4c87-a8e8-c376d9c899b2} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:01.225777 [ 9181 ] {d29d864d-6bc9-475d-b327-f185071f238c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36196) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:01.273254 [ 9181 ] {d29d864d-6bc9-475d-b327-f185071f238c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=12, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:03.391802 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {eca2e068-f817-4cd0-b4bb-4c92546607ab::202503_1_91_18}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:04.080276 [ 8742 ] {23e2830e-8610-4f96-918a-8a70679ea383} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36192) (comment: 02383_analyzer_merge_tree_self_join.sql) (in query: INSERT INTO test_table_join_1 VALUES ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6

2025.03.05 22:41:04.103225 [ 8742 ] {23e2830e-8610-4f96-918a-8a70679ea383} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6

2025.03.05 22:41:05.621045 [ 9181 ] {0fae393f-c6e1-43b5-b5eb-a9ac4ad10581} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=42, jobs=42). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34350) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: select count() from system.columns where table='concurrent_alter_add_drop_steroids_3' and database='test_iqnfimmp'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:05.743191 [ 9181 ] {0fae393f-c6e1-43b5-b5eb-a9ac4ad10581} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=42, jobs=42). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:06.022174 [ 3550 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/yxz/ihukeunwjrjunnfczzincnebrndsl, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 5ad516fc-92d5-4d61-a565-b8d75b447b6f, upload has finished false.
2025.03.05 22:41:06.033915 [ 3550 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/yxz/ihukeunwjrjunnfczzincnebrndsl, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 5ad516fc-92d5-4d61-a565-b8d75b447b6f, upload has finished false
2025.03.05 22:41:06.093960 [ 3550 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/yxz/ihukeunwjrjunnfczzincnebrndsl, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 5ad516fc-92d5-4d61-a565-b8d75b447b6f, upload has finished false
2025.03.05 22:41:06.164911 [ 3550 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 15 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:09.209513 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:10.506428 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:10.806952 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38ea0
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:10.821381 [ 3633 ] {} <Error> void DB::SystemLog<DB::TraceLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:11.001025 [ 9181 ] {249a9959-ae42-4df9-8258-fd9345f4b7c4} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34412) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: select count() from system.columns where table='concurrent_alter_add_drop_steroids_1' and database='test_iqnfimmp'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:11.104109 [ 9181 ] {249a9959-ae42-4df9-8258-fd9345f4b7c4} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:11.291728 [ 9183 ] {4a0bd2a9-4e6c-4230-a927-f432542f869e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=39, jobs=39). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34420) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:11.399441 [ 9183 ] {4a0bd2a9-4e6c-4230-a927-f432542f869e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=39, jobs=39). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:13.245878 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fa086384-106f-49e6-9839-1a8d6bb5f31b::202503_1_13_3}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:13.508233 [ 9178 ] {9ec9a75d-f89d-4919-b35a-920a95425cbf} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=10, jobs=10). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34380) (comment: 00720_with_cube.sql) (in query: SELECT a, b, sum(s), count() from cube GROUP BY CUBE(a, b) WITH TOTALS ORDER BY a, b;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:13.693770 [ 9178 ] {9ec9a75d-f89d-4919-b35a-920a95425cbf} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=10, jobs=10). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:16.249752 [ 8742 ] {5044ec8c-30c4-4f21-9013-b951e15ee62b} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39526) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:16.313725 [ 8742 ] {5044ec8c-30c4-4f21-9013-b951e15ee62b} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:18.275619 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:19.262433 [ 3550 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/lie/fftfdypnbaiwlqdsbrjurxxttngqk, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 39af660d-26f9-428d-ad0b-ae20e5191a3a, upload has finished false.
2025.03.05 22:41:19.271487 [ 3550 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/lie/fftfdypnbaiwlqdsbrjurxxttngqk, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 39af660d-26f9-428d-ad0b-ae20e5191a3a, upload has finished false
2025.03.05 22:41:19.336345 [ 3550 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/lie/fftfdypnbaiwlqdsbrjurxxttngqk, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 39af660d-26f9-428d-ad0b-ae20e5191a3a, upload has finished false
2025.03.05 22:41:19.416300 [ 3550 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 31 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:20.976119 [ 3550 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:21.237766 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column Referer): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_1_1_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 32 with max_rows_to_read = 6658): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:21.425952 [ 9181 ] {7a3b5b2e-893c-4263-b0d3-d7a170e0f8e1} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39584) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:21.507654 [ 9181 ] {7a3b5b2e-893c-4263-b0d3-d7a170e0f8e1} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:26.395097 [ 8742 ] {ed03d483-9d22-49f1-a4c9-cd4c0f07ca15} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38698) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:26.437623 [ 8742 ] {ed03d483-9d22-49f1-a4c9-cd4c0f07ca15} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:26.654512 [ 9183 ] {ea6f59c1-e303-4fa4-bc19-04aabfa98d8c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38682) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: select count() from system.columns where table='concurrent_alter_add_drop_steroids_1' and database='test_iqnfimmp'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:26.701598 [ 9183 ] {ea6f59c1-e303-4fa4-bc19-04aabfa98d8c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:30.771494 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {9f912096-7afb-496b-86c7-16abf59bb4e4::202503_1_100_20}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:31.243636 [ 9183 ] {99b5ccda-d8de-4681-8b46-276ffcac12fb} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=44, jobs=44). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38740) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: select count() from system.columns where table='concurrent_alter_add_drop_steroids_2' and database='test_iqnfimmp'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:31.364791 [ 9183 ] {99b5ccda-d8de-4681-8b46-276ffcac12fb} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=44, jobs=44). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:31.727948 [ 3780 ] {5d61023d-9940-431b-9f72-3133031f0073} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37520) (comment: 00162_mmap_compression_none.sql) (in query: SELECT sum(length(Title)) FROM hits_none;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:41:31.759751 [ 3780 ] {5d61023d-9940-431b-9f72-3133031f0073} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:41:32.338170 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/xeb/kzvlafqaafpzdnrfdaagpspddtgkb, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2adb7bb9-1002-40f7-954e-e45bdf0a76dd, upload has finished false.
2025.03.05 22:41:32.338980 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/xeb/kzvlafqaafpzdnrfdaagpspddtgkb, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2adb7bb9-1002-40f7-954e-e45bdf0a76dd, upload has finished false
2025.03.05 22:41:32.402529 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/xeb/kzvlafqaafpzdnrfdaagpspddtgkb, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2adb7bb9-1002-40f7-954e-e45bdf0a76dd, upload has finished false
2025.03.05 22:41:32.575806 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 31 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:33.065522 [ 9183 ] {4c97988f-4e08-4501-b35b-9dd011b7bb9e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=962, jobs=844). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46124) (comment: 02246_tsv_csv_best_effort_schema_inference.sh) (in query: select * from file('test_02149.data', 'CSV')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:41:33.124095 [ 9183 ] {4c97988f-4e08-4501-b35b-9dd011b7bb9e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=962, jobs=844). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:41:35.774223 [ 8742 ] {dda700e4-09a1-49dd-81f4-fda38b73e23e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46130) (comment: 00015_totals_and_no_aggregate_functions.sql) (in query: SELECT AdvEngineID FROM test.hits GROUP BY AdvEngineID WITH TOTALS ORDER BY AdvEngineID ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:35.861006 [ 9183 ] {028b619d-8ba0-4773-8f97-733e683afdbb} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=19, jobs=19). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46132) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: select count() from system.columns where table='concurrent_alter_add_drop_steroids_3' and database='test_iqnfimmp'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:35.894284 [ 9183 ] {028b619d-8ba0-4773-8f97-733e683afdbb} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=19, jobs=19). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:36.230807 [ 8742 ] {dda700e4-09a1-49dd-81f4-fda38b73e23e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:36.524359 [ 9184 ] {aaf676e9-7451-468d-afee-2bc48c3ac9fa} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46146) (comment: 00012_sorting_distributed.sql) (in query: SELECT EventTime::DateTime('Asia/Dubai') FROM remote('127.0.0.{1,2}', test, hits) ORDER BY EventTime DESC LIMIT 10 ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:36.530082 [ 9184 ] {aaf676e9-7451-468d-afee-2bc48c3ac9fa} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:41.200344 [ 3585 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Removing temporary directory /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:41:41.200996 [ 3585 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:41:41.202569 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/gwo/amkucyjcfmhbnptnkqaztfvhggixk, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id ef9ab67c-4c74-4387-89aa-64620a2be211, upload has finished false.
2025.03.05 22:41:41.204099 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/gwo/amkucyjcfmhbnptnkqaztfvhggixk, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id ef9ab67c-4c74-4387-89aa-64620a2be211, upload has finished false
2025.03.05 22:41:41.244154 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/gwo/amkucyjcfmhbnptnkqaztfvhggixk, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id ef9ab67c-4c74-4387-89aa-64620a2be211, upload has finished false
2025.03.05 22:41:41.324377 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 19 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:41.520058 [ 8748 ] {ba59425e-ab12-4b44-a6fa-3ce913ff796c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46214) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:41.566325 [ 8748 ] {ba59425e-ab12-4b44-a6fa-3ce913ff796c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:44.258179 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:44.635219 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {388a668d-c3ee-4b85-bfa8-acb99b8c5d8d::202503_1_66_13}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:45.523919 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:46.871704 [ 3542 ] {} <Error> 86d8a18b-f46f-4d5d-aa87-dc0348cdf6d3::all_5_11_1_15 (MutateFromLogEntryTask): virtual bool DB::ReplicatedMergeMutateTaskBase::executeStep(): Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a357647
21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3573b9
22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a927662
23. /build/src/Storages/MergeTree/MutateTask.cpp:927: DB::MutationHelpers::finalizeMutatedPart(std::shared_ptr<DB::IMergeTreeDataPart const> const&, std::shared_ptr<DB::IMergeTreeDataPart>, DB::ExecuteTTLType, std::shared_ptr<DB::ICompressionCodec> const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageInMemoryMetadata const>, bool) @ 0x000000001cf4a5de
24. /build/src/Storages/MergeTree/MutateTask.cpp:1937: DB::MutateSomePartColumnsTask::finalize() @ 0x000000001cf7a6e8
25. /build/src/Storages/MergeTree/MutateTask.cpp:1737: DB::MutateSomePartColumnsTask::executeStep() @ 0x000000001cf78002
26. /build/src/Storages/MergeTree/MutateTask.cpp:2010: DB::MutateTask::execute() @ 0x000000001cf4c98f
27. /build/src/Storages/MergeTree/MutateFromLogEntryTask.h:44: DB::MutateFromLogEntryTask::executeInnerTask() @ 0x000000001cf48504
28. /build/src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:208: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x000000001cfe8d99
29. /build/src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:47: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x000000001cfe6f80
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:46.881445 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {86d8a18b-f46f-4d5d-aa87-dc0348cdf6d3::all_5_11_1_15}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/IO/WriteBufferFromFileDecorator.cpp:0: DB::WriteBufferFromFileDecorator::finalizeImpl() @ 0x000000001a357647
21. /build/src/Disks/IO/WriteBufferWithFinalizeCallback.cpp:18: DB::WriteBufferWithFinalizeCallback::finalizeImpl() @ 0x000000001a3573b9
22. /build/src/IO/WriteBuffer.h:127: DB::WriteBuffer::finalize() @ 0x000000000a927662
23. /build/src/Storages/MergeTree/MutateTask.cpp:927: DB::MutationHelpers::finalizeMutatedPart(std::shared_ptr<DB::IMergeTreeDataPart const> const&, std::shared_ptr<DB::IMergeTreeDataPart>, DB::ExecuteTTLType, std::shared_ptr<DB::ICompressionCodec> const&, std::shared_ptr<DB::Context const>, std::shared_ptr<DB::StorageInMemoryMetadata const>, bool) @ 0x000000001cf4a5de
24. /build/src/Storages/MergeTree/MutateTask.cpp:1937: DB::MutateSomePartColumnsTask::finalize() @ 0x000000001cf7a6e8
25. /build/src/Storages/MergeTree/MutateTask.cpp:1737: DB::MutateSomePartColumnsTask::executeStep() @ 0x000000001cf78002
26. /build/src/Storages/MergeTree/MutateTask.cpp:2010: DB::MutateTask::execute() @ 0x000000001cf4c98f
27. /build/src/Storages/MergeTree/MutateFromLogEntryTask.h:44: DB::MutateFromLogEntryTask::executeInnerTask() @ 0x000000001cf48504
28. /build/src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:208: DB::ReplicatedMergeMutateTaskBase::executeImpl() @ 0x000000001cfe8d99
29. /build/src/Storages/MergeTree/ReplicatedMergeMutateTaskBase.cpp:47: DB::ReplicatedMergeMutateTaskBase::executeStep() @ 0x000000001cfe6f80
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
 (version 24.3.12.76.altinitystable)
2025.03.05 22:41:47.430188 [ 8742 ] {b750c20c-9215-46f6-9863-9f3fca24f62a} <Error> executeQuery: Code: 341. DB::Exception: Exception happened during execution of mutation '0000000002' with part 'all_5_11_1_14' reason: 'Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable)'. This error maybe retryable or not. In case of unretryable error, mutation can be killed with KILL MUTATION query. (UNFINISHED) (version 24.3.12.76.altinitystable) (from [::1]:46184) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ALTER TABLE concurrent_alter_add_drop_steroids_1 MODIFY COLUMN value0 String SETTINGS replication_alter_partitions_sync=2), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, String, String&, String&>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<String&>::type, std::type_identity<String&>::type>, char const*&&, String&&, String&, String&) @ 0x000000001ce26c04
6. /build/src/Storages/MergeTree/MergeTreeMutationStatus.cpp:26: DB::checkMutationStatus(std::optional<DB::MergeTreeMutationStatus>&, std::set<String, std::less<String>, std::allocator<String>> const&) @ 0x000000001ce269a0
7. /build/src/Storages/StorageReplicatedMergeTree.cpp:676: DB::StorageReplicatedMergeTree::waitMutationToFinishOnReplicas(std::vector<String, std::allocator<String>> const&, String const&) const @ 0x000000001c4c6686
8. /build/src/Storages/StorageReplicatedMergeTree.cpp:7529: DB::StorageReplicatedMergeTree::waitMutation(String const&, unsigned long) const @ 0x000000001c5541f9
9. /build/src/Storages/StorageReplicatedMergeTree.cpp:6294: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c553411
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
11. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
12. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
21. ? @ 0x00007f7a996d8ac3
22. ? @ 0x00007f7a9976a850

2025.03.05 22:41:47.432196 [ 9184 ] {f2d24c23-b0c8-47ad-8f3e-65a6ef7210ec} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=33, jobs=33). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37998) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:47.433975 [ 9183 ] {9155bed3-de61-4fc4-8fd5-a8011d3eeb04} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=14). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:37984) (comment: 00024_random_counters.sql) (in query: SELECT uniq(UserID), sum(Sign) FROM test.visits WHERE CounterID = 32152608;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:47.457691 [ 9184 ] {f2d24c23-b0c8-47ad-8f3e-65a6ef7210ec} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=33, jobs=33). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:47.468828 [ 9183 ] {9155bed3-de61-4fc4-8fd5-a8011d3eeb04} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=14). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:41:47.493322 [ 8742 ] {b750c20c-9215-46f6-9863-9f3fca24f62a} <Error> TCPHandler: Code: 341. DB::Exception: Exception happened during execution of mutation '0000000002' with part 'all_5_11_1_14' reason: 'Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable)'. This error maybe retryable or not. In case of unretryable error, mutation can be killed with KILL MUTATION query. (UNFINISHED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, String, String&, String&>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<String&>::type, std::type_identity<String&>::type>, char const*&&, String&&, String&, String&) @ 0x000000001ce26c04
6. /build/src/Storages/MergeTree/MergeTreeMutationStatus.cpp:26: DB::checkMutationStatus(std::optional<DB::MergeTreeMutationStatus>&, std::set<String, std::less<String>, std::allocator<String>> const&) @ 0x000000001ce269a0
7. /build/src/Storages/StorageReplicatedMergeTree.cpp:676: DB::StorageReplicatedMergeTree::waitMutationToFinishOnReplicas(std::vector<String, std::allocator<String>> const&, String const&) const @ 0x000000001c4c6686
8. /build/src/Storages/StorageReplicatedMergeTree.cpp:7529: DB::StorageReplicatedMergeTree::waitMutation(String const&, unsigned long) const @ 0x000000001c5541f9
9. /build/src/Storages/StorageReplicatedMergeTree.cpp:6294: DB::StorageReplicatedMergeTree::alter(DB::AlterCommands const&, std::shared_ptr<DB::Context const>, std::unique_lock<std::timed_mutex>&) @ 0x000000001c553411
10. /build/src/Interpreters/InterpreterAlterQuery.cpp:201: DB::InterpreterAlterQuery::executeToTable(DB::ASTAlterQuery const&) @ 0x000000001aff9070
11. /build/src/Interpreters/InterpreterAlterQuery.cpp:67: DB::InterpreterAlterQuery::execute() @ 0x000000001aff6ade
12. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
13. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
14. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
15. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
16. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
17. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
18. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
19. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
20. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
21. ? @ 0x00007f7a996d8ac3
22. ? @ 0x00007f7a9976a850

2025.03.05 22:41:52.892042 [ 9875 ] {48d142de-eb24-45da-8c88-829571dc2373} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38058) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:52.917997 [ 9875 ] {48d142de-eb24-45da-8c88-829571dc2373} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:41:56.849356 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:04.844546 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:05.169178 [ 8742 ] {50daaed0-6e75-4b1d-a6a6-236cbbda83b4} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38032) (comment: 00089_position_functions_with_non_constant_arg.sql) (in query: SELECT count() FROM test.hits WHERE positionCaseInsensitive(URL, 'metrika') != positionCaseInsensitive(URL, materialize('metrika'));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:42:05.187243 [ 8742 ] {50daaed0-6e75-4b1d-a6a6-236cbbda83b4} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:42:07.265806 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:07.637081 [ 3780 ] {907cdfa5-92b6-4694-bc66-3dca1c46c168} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43928) (comment: 02233_optimize_aggregation_in_order_prefix_with_merge.sql) (in query: CREATE TABLE data_02233 (`partition` Int, `parent_key` Int, `child_key` Int, `value` Int) ENGINE = MergeTree PARTITION BY partition ORDER BY parent_key SETTINGS index_granularity = 12016, min_bytes_for_wide_part = 0, ratio_of_defaults_for_sparse_serialization = 0., replace_long_file_name_to_hash = false, max_file_name_length = 128, min_bytes_for_full_part_storage = 536870912, compact_parts_max_bytes_to_buffer = 179045625, compact_parts_max_granules_to_buffer = 1, compact_parts_merge_max_bytes_to_prefetch_part = 24354762, merge_max_block_size = 20996, old_parts_lifetime = 313., prefer_fetch_merged_part_size_threshold = 1, vertical_merge_algorithm_min_rows_to_activate = 1000000, vertical_merge_algorithm_min_columns_to_activate = 100, min_merge_bytes_to_use_direct_io = 1, index_granularity_bytes = 14014446, concurrent_part_removal_threshold = 0, allow_vertical_merges_from_compact_to_wide_parts = true, cache_populated_by_fetch = true, marks_compress_block_size = 63866, primary_key_compress_block_size = 35970), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:169: DB::ThreadPoolCallbackRunnerLocal<void, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>, std::function<void ()>>::operator()(std::function<void ()>&&, Priority) @ 0x0000000018f67c7a
10. /build/src/Storages/MergeTree/MergeTreeData.cpp:1703: DB::MergeTreeData::loadDataParts(bool, std::optional<std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>>) @ 0x000000001cbc5677
11. /build/src/Storages/StorageMergeTree.cpp:120: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>) @ 0x000000001d0ea014
12. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageMergeTree* std::construct_at[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::StorageMergeTree*>(DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e99b7
13. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageMergeTree>>::construct[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void, void>(std::allocator<DB::StorageMergeTree>&, DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e96c7
14. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>>(std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e9375
15. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e91a7
16. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageMergeTree> std::make_shared[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e636d
17. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:741: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e3eaa
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019306cfd
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x0000000019306cbd
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019306c7d
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019306c45
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
24. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
25. /build/src/Interpreters/InterpreterCreateQuery.cpp:1493: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x000000001b01d20c
26. /build/src/Interpreters/InterpreterCreateQuery.cpp:1313: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b017166
27. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe96
28. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
29. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
30. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
31. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5

2025.03.05 22:42:07.657087 [ 3780 ] {907cdfa5-92b6-4694-bc66-3dca1c46c168} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:169: DB::ThreadPoolCallbackRunnerLocal<void, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>, std::function<void ()>>::operator()(std::function<void ()>&&, Priority) @ 0x0000000018f67c7a
10. /build/src/Storages/MergeTree/MergeTreeData.cpp:1703: DB::MergeTreeData::loadDataParts(bool, std::optional<std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>>) @ 0x000000001cbc5677
11. /build/src/Storages/StorageMergeTree.cpp:120: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>) @ 0x000000001d0ea014
12. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageMergeTree* std::construct_at[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::StorageMergeTree*>(DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e99b7
13. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageMergeTree>>::construct[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void, void>(std::allocator<DB::StorageMergeTree>&, DB::StorageMergeTree*, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e96c7
14. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>>(std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e9375
15. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageMergeTree> std::allocate_shared[abi:v15000]<DB::StorageMergeTree, std::allocator<DB::StorageMergeTree>, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(std::allocator<DB::StorageMergeTree> const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e91a7
16. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageMergeTree> std::make_shared[abi:v15000]<DB::StorageMergeTree, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, void>(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&) @ 0x000000001d0e636d
17. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:741: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e3eaa
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019306cfd
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x0000000019306cbd
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019306c7d
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019306c45
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
24. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
25. /build/src/Interpreters/InterpreterCreateQuery.cpp:1493: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x000000001b01d20c
26. /build/src/Interpreters/InterpreterCreateQuery.cpp:1313: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b017166
27. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe96
28. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
29. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
30. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
31. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5

2025.03.05 22:42:07.811892 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column StartTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_1_1_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 1 with max_rows_to_read = 6658): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:09.537643 [ 3541 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fe5b5b83-eea3-482d-90c9-5c8d7754068a::202503_1_95_19}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:09.624622 [ 9181 ] {3141caa9-f96a-4ffc-9c76-3ec2be7f79ad} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43942) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:42:10.010805 [ 9181 ] {3141caa9-f96a-4ffc-9c76-3ec2be7f79ad} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:42:11.268107 [ 8742 ] {7389d97b-62d4-4c67-aa98-cdbdbab815bd} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43948) (comment: 00084_external_aggregation.sql) (in query: SELECT URL, uniq(SearchPhrase) AS u FROM test.hits GROUP BY URL ORDER BY u DESC, URL LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/SerializationSparse.cpp:165: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x000000001a051489

2025.03.05 22:42:12.289831 [ 8742 ] {7389d97b-62d4-4c67-aa98-cdbdbab815bd} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/SerializationSparse.cpp:165: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x000000001a051489

2025.03.05 22:42:14.372895 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=1): (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_3_3_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6608): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:17.992803 [ 9181 ] {475edab5-8477-4bd5-951f-aa5fd2ea819c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=962, jobs=845). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38566) (comment: 00020_distinct_order_by_distributed.sql) (in query: SELECT count() FROM (SELECT DISTINCT PredLastVisit AS x FROM remote('127.0.0.{1,2}', test, visits) ORDER BY VisitID);), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:42:18.028408 [ 9181 ] {475edab5-8477-4bd5-951f-aa5fd2ea819c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=962, jobs=845). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:42:18.581669 [ 9184 ] {6bf73c96-8ac5-487c-82a6-5dff3e2df9bd} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=18, jobs=18). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38598) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: SELECT count() FROM system.processes WHERE current_database=currentDatabase() AND query LIKE '%concurrent_alter_add_drop_steroids_%'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:42:18.594399 [ 3584 ] {} <Warning> test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92): Removing temporary directory /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/tmp_merge_201403_1_6_1/
2025.03.05 22:42:18.596080 [ 3584 ] {} <Warning> test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/tmp_merge_201403_1_6_1/
2025.03.05 22:42:18.780226 [ 9184 ] {6bf73c96-8ac5-487c-82a6-5dff3e2df9bd} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=18, jobs=18). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:42:18.953778 [ 3541 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=1): (while reading column Sign): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_4_4_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6741): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:19.227497 [ 9183 ] {bbaf520a-ab3a-4454-bbd6-b3f54cebe130} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38020) (comment: 00171_grouping_aggregated_transform_bug.sql) (in query: SELECT sum(cityHash64(*)) FROM (SELECT CounterID, quantileTiming(0.5)(SendTiming), count() FROM remote('127.0.0.{1,2,3,4,5,6,7,8,9,10}', test.hits) WHERE SendTiming != -1 GROUP BY CounterID) SETTINGS max_block_size = 63169;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:42:19.824732 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/his/iyouojcrhggflfpjnsgpslypesfaw, total size 469762048, count 469762048, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 38feb73e-d9e9-4ac5-bcec-ba3d555019ca, upload has finished false.
2025.03.05 22:42:19.827268 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/his/iyouojcrhggflfpjnsgpslypesfaw, total size 469762048, count 469762048, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 38feb73e-d9e9-4ac5-bcec-ba3d555019ca, upload has finished false
2025.03.05 22:42:19.998116 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/his/iyouojcrhggflfpjnsgpslypesfaw, total size 469762048, count 469762048, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 38feb73e-d9e9-4ac5-bcec-ba3d555019ca, upload has finished false
2025.03.05 22:42:20.075696 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 96 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:20.252972 [ 9183 ] {bbaf520a-ab3a-4454-bbd6-b3f54cebe130} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:42:20.278750 [ 9178 ] {fbdccfcb-85c1-437c-bf95-9071fd25c26d} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=22, jobs=22). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38602) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:42:20.338770 [ 9178 ] {fbdccfcb-85c1-437c-bf95-9071fd25c26d} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=22, jobs=22). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:42:21.074409 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:23.527867 [ 3548 ] {b5c1a781-0b5c-4dfb-bb23-0f220cedfbbd::all_1_7_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/ozw/thngbrfrlohathpbgyqkpkkieadms, total size 352321536, count 352321536, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id c297c4a5-e69b-4c33-a8b0-426ab10695e0, upload has finished false.
2025.03.05 22:42:23.529603 [ 3548 ] {b5c1a781-0b5c-4dfb-bb23-0f220cedfbbd::all_1_7_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/ozw/thngbrfrlohathpbgyqkpkkieadms, total size 352321536, count 352321536, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id c297c4a5-e69b-4c33-a8b0-426ab10695e0, upload has finished false
2025.03.05 22:42:23.672352 [ 3548 ] {b5c1a781-0b5c-4dfb-bb23-0f220cedfbbd::all_1_7_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/ozw/thngbrfrlohathpbgyqkpkkieadms, total size 352321536, count 352321536, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id c297c4a5-e69b-4c33-a8b0-426ab10695e0, upload has finished false
2025.03.05 22:42:23.707079 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {b5c1a781-0b5c-4dfb-bb23-0f220cedfbbd::all_1_7_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:567: DB::WriteBufferFromS3::writePart(DB::WriteBufferFromS3::PartData&&) @ 0x000000001991336e
18. /build/src/IO/WriteBufferFromS3.cpp:370: DB::WriteBufferFromS3::writeMultipartUpload() @ 0x00000000199074b6
19. /build/src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::nextImpl() @ 0x0000000019906b7e
20. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
21. /build/src/IO/WriteBufferFromFileDecorator.cpp:71: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x000000001a3579ad
22. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
23. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
24. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
25. /build/src/IO/WriteBuffer.h:76: DB::WriteBuffer::nextIfAtEnd() @ 0x000000000a92ff78
26. /build/src/IO/WriteBuffer.h:91: DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000a92fde0
27. /build/src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x0000000019ddbded
28. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
29. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
30. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
31. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:237: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000001ccd146e
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:24.172744 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 4 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:25.361920 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=1): (while reading column StartDate): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_2_2_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6592): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:30.524576 [ 9181 ] {4f97af01-b44c-4b21-9b9f-486e97e4ace7} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38628) (comment: 00915_simple_aggregate_function.sql) (in query: optimize table simple final;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.h:104: DB::executeHere(std::shared_ptr<DB::MergePlainMergeTreeTask>) @ 0x000000001d0f9984
28. /build/src/Storages/StorageMergeTree.cpp:1174: DB::StorageMergeTree::merge(bool, String const&, bool, bool, std::vector<String, std::allocator<String>> const&, bool, std::shared_ptr<DB::MergeTreeTransaction> const&, String&, bool) @ 0x000000001d0f984f
29. /build/src/Storages/StorageMergeTree.cpp:1587: DB::StorageMergeTree::optimize(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::IAST> const&, bool, bool, std::vector<String, std::allocator<String>> const&, bool, std::shared_ptr<DB::Context const>) @ 0x000000001d1005d7
30. /build/src/Interpreters/InterpreterOptimizeQuery.cpp:84: DB::InterpreterOptimizeQuery::execute() @ 0x000000001bc1ad45
31. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7

2025.03.05 22:42:30.551613 [ 9181 ] {4f97af01-b44c-4b21-9b9f-486e97e4ace7} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.h:104: DB::executeHere(std::shared_ptr<DB::MergePlainMergeTreeTask>) @ 0x000000001d0f9984
28. /build/src/Storages/StorageMergeTree.cpp:1174: DB::StorageMergeTree::merge(bool, String const&, bool, bool, std::vector<String, std::allocator<String>> const&, bool, std::shared_ptr<DB::MergeTreeTransaction> const&, String&, bool) @ 0x000000001d0f984f
29. /build/src/Storages/StorageMergeTree.cpp:1587: DB::StorageMergeTree::optimize(std::shared_ptr<DB::IAST> const&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::IAST> const&, bool, bool, std::vector<String, std::allocator<String>> const&, bool, std::shared_ptr<DB::Context const>) @ 0x000000001d1005d7
30. /build/src/Interpreters/InterpreterOptimizeQuery.cpp:84: DB::InterpreterOptimizeQuery::execute() @ 0x000000001bc1ad45
31. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7

2025.03.05 22:42:30.973350 [ 3923 ] {4951f022-666a-4d83-b752-0fad63805ffe} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48392) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:42:31.016115 [ 3923 ] {4951f022-666a-4d83-b752-0fad63805ffe} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=24, jobs=24). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:42:32.340200 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/lpw/yqgzpaiqieduueelxlcjnaotshooo, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b3ac0004-297a-4c72-9cc4-f5ef3f2e1a8a, upload has finished false.
2025.03.05 22:42:32.344385 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/lpw/yqgzpaiqieduueelxlcjnaotshooo, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b3ac0004-297a-4c72-9cc4-f5ef3f2e1a8a, upload has finished false
2025.03.05 22:42:32.402656 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/lpw/yqgzpaiqieduueelxlcjnaotshooo, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b3ac0004-297a-4c72-9cc4-f5ef3f2e1a8a, upload has finished false
2025.03.05 22:42:32.588958 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 19 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:33.674704 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:34.316795 [ 9184 ] {172fae03-dc5f-41cf-be7e-0c13508fc3bf} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=34): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48374) (comment: 00030_array_enumerate_uniq.sql) (in query: SELECT max(arrayJoin(arrayEnumerateUniq(arrayMap(x -> intDiv(x, 10), URLCategories)))) FROM test.hits ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:42:36.629757 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38ea0
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:37.392218 [ 3541 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=10): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 5 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:37.578636 [ 9184 ] {172fae03-dc5f-41cf-be7e-0c13508fc3bf} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=34): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:42:37.695302 [ 5724 ] {ab5384f4-80f3-4b0f-8117-56dc893539f5} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39022) (comment: 00139_like.sql) (in query: /* Note that queries are written as the user doesn't really understand that the symbol _ has special meaning in LIKE pattern. */
 SELECT count() FROM test.hits WHERE URL LIKE '%/avtomobili_s_probegom/_%__%__%__%';), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:42:39.433856 [ 5724 ] {ab5384f4-80f3-4b0f-8117-56dc893539f5} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:42:41.016664 [ 5724 ] {a54e9664-842c-4897-8cc2-f921d1e2f24a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39072) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:42:41.102605 [ 5724 ] {a54e9664-842c-4897-8cc2-f921d1e2f24a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:42:44.312941 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 10 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:46.121515 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7a26c9c9-7195-4e8c-807c-8ccd93ff5af2::202503_1_100_19}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:46.242980 [ 9877 ] {41dcd7e4-3c51-461b-b8e3-daa46b1d1195} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39044) (comment: 01798_uniq_theta_union_intersect_not.sql) (in query: INSERT INTO TABLE test1(year, uv) select '2021',uniqThetaState(toInt64(2));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d511b1d
13. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d5119aa
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d511939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d51189d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'()::operator()() @ 0x000000001d5117a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5116f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5116d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5116a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:42:46.319202 [ 9877 ] {41dcd7e4-3c51-461b-b8e3-daa46b1d1195} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d511b1d
13. /build/src/Processors/Executors/CompletedPipelineExecutor.cpp:90: DB::CompletedPipelineExecutor::execute()::$_0::operator()() const @ 0x000000001d5119aa
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d511939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&) @ 0x000000001d51189d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::CompletedPipelineExecutor::execute()::$_0>(DB::CompletedPipelineExecutor::execute()::$_0&&)::'lambda'()::operator()() @ 0x000000001d5117a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d511715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5116f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5116d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5116a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:42:46.747626 [ 3923 ] {51357d3e-a004-48bc-b293-d1089593f6c4} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 17.97 MiB (attempt to allocate chunk of 1986053 bytes), maximum: 9.31 GiB: Memory tracker (for query): fault injected. Would use 17.97 MiB (attempt to allocate chunk of 1986053 bytes), maximum: 9.31 GiB, current cache state: File segment: [0, 350806], key: fa16b35c5c52da882153f7571a318300, state: DOWNLOADING, downloaded size: 0, reserved size: 350807, downloader id: 51357d3e-a004-48bc-b293-d1089593f6c4:4549, current write offset: 0, caller id: 51357d3e-a004-48bc-b293-d1089593f6c4:4549, kind: Regular, unbound: 0: Cache info: Buffer path: s3/vor/krokxwfehpnsarazutoivazbykkfy, hash key: fa16b35c5c52da882153f7571a318300, file_offset_of_buffer_end: 0, read_until_position: 195063, internal buffer end: 350807, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 51357d3e-a004-48bc-b293-d1089593f6c4:4549, file segment info: File segment: [0, 350806], key: fa16b35c5c52da882153f7571a318300, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 350807, downloader id: 51357d3e-a004-48bc-b293-d1089593f6c4:4549, current write offset: 0, caller id: 51357d3e-a004-48bc-b293-d1089593f6c4:4549, kind: Regular, unbound: 0: (while reading column SendTiming): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/1ac/1acd413c-abb9-47e7-b5ab-2834f577d1ca/201403_26_26_0/ in table test.hits (1acd413c-abb9-47e7-b5ab-2834f577d1ca) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 81000): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (MEMORY_LIMIT_EXCEEDED) (version 24.3.12.76.altinitystable) (from [::1]:39076) (comment: 00150_quantiles_timing_precision.sql) (in query: SELECT CounterID, quantileTiming(0.5)(SendTiming) AS qt, least(30000, quantileExact(0.5)(SendTiming)) AS qe, count() AS c, round(abs(qt - qe) / greatest(qt, qe) AS diff, 3) AS rounded_diff FROM test.hits WHERE SendTiming != -1 GROUP BY CounterID HAVING diff != 0 ORDER BY diff DESC;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000132e9d7a
6. /build/src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e7feb
7. /build/src/Common/MemoryTracker.cpp:398: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e8862
8. /build/src/Common/CurrentMemoryTracker.cpp:58: CurrentMemoryTracker::allocImpl(long, bool) @ 0x00000000132554f1
9. /build/src/Common/CurrentMemoryTracker.cpp:90: CurrentMemoryTracker::alloc(long) @ 0x0000000013255701
10. /build/src/Common/Allocator.cpp:114: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000132536e6
11. /build/src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x000000001335e8ec
12. /build/src/IO/BufferWithOwnMemory.h:50: DB::Memory<Allocator<false, false>>::Memory(unsigned long, unsigned long) @ 0x000000001335e720
13. /build/src/IO/BufferWithOwnMemory.h:157: DB::BufferWithOwnMemory<DB::WriteBuffer>::BufferWithOwnMemory(unsigned long, char*, unsigned long) @ 0x000000001338b815
14. /build/src/IO/WriteBufferFromFileBase.cpp:7: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001338b771
15. /build/src/IO/WriteBufferFromFileDescriptor.cpp:98: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x000000001338ae24
16. /build/src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x000000001352961c
17. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, String const&>(String const&) @ 0x00000000136b1027
18. /build/src/Interpreters/Cache/FileSegment.cpp:387: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000001bc9b814
19. /build/src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:769: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000001933db8e
20. /build/src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:1001: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000193415c9
21. /build/src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:795: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000001933e9b9
22. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5da6a
23. /build/src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:209: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000001932ec9a
24. /build/src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:181: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000001932ebdb
25. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5da6a
26. /build/src/IO/ReadBuffer.h:106: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x0000000019dd9bb8
27. /build/src/Compression/CompressedReadBufferFromFile.cpp:108: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x0000000019ddb52e
28. /build/src/DataTypes/Serializations/SerializationNumber.cpp:221: DB::SerializationNumber<int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000001a032bba
29. /build/src/DataTypes/Serializations/ISerialization.cpp:146: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000019fcf81a
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:363: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000001ce6a40c
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:151: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000001ce69de7

2025.03.05 22:42:47.383179 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7a26c9c9-7195-4e8c-807c-8ccd93ff5af2::202503_1_100_19}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:48.070087 [ 3923 ] {51357d3e-a004-48bc-b293-d1089593f6c4} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 17.97 MiB (attempt to allocate chunk of 1986053 bytes), maximum: 9.31 GiB: Memory tracker (for query): fault injected. Would use 17.97 MiB (attempt to allocate chunk of 1986053 bytes), maximum: 9.31 GiB, current cache state: File segment: [0, 350806], key: fa16b35c5c52da882153f7571a318300, state: DOWNLOADING, downloaded size: 0, reserved size: 350807, downloader id: 51357d3e-a004-48bc-b293-d1089593f6c4:4549, current write offset: 0, caller id: 51357d3e-a004-48bc-b293-d1089593f6c4:4549, kind: Regular, unbound: 0: Cache info: Buffer path: s3/vor/krokxwfehpnsarazutoivazbykkfy, hash key: fa16b35c5c52da882153f7571a318300, file_offset_of_buffer_end: 0, read_until_position: 195063, internal buffer end: 350807, read_type: REMOTE_FS_READ_AND_PUT_IN_CACHE, last caller: 51357d3e-a004-48bc-b293-d1089593f6c4:4549, file segment info: File segment: [0, 350806], key: fa16b35c5c52da882153f7571a318300, state: PARTIALLY_DOWNLOADED_NO_CONTINUATION, downloaded size: 0, reserved size: 350807, downloader id: 51357d3e-a004-48bc-b293-d1089593f6c4:4549, current write offset: 0, caller id: 51357d3e-a004-48bc-b293-d1089593f6c4:4549, kind: Regular, unbound: 0: (while reading column SendTiming): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/1ac/1acd413c-abb9-47e7-b5ab-2834f577d1ca/201403_26_26_0/ in table test.hits (1acd413c-abb9-47e7-b5ab-2834f577d1ca) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 81000): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000132e9d7a
6. /build/src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e7feb
7. /build/src/Common/MemoryTracker.cpp:398: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e8862
8. /build/src/Common/CurrentMemoryTracker.cpp:58: CurrentMemoryTracker::allocImpl(long, bool) @ 0x00000000132554f1
9. /build/src/Common/CurrentMemoryTracker.cpp:90: CurrentMemoryTracker::alloc(long) @ 0x0000000013255701
10. /build/src/Common/Allocator.cpp:114: Allocator<false, false>::alloc(unsigned long, unsigned long) @ 0x00000000132536e6
11. /build/src/IO/BufferWithOwnMemory.h:130: DB::Memory<Allocator<false, false>>::alloc(unsigned long) @ 0x000000001335e8ec
12. /build/src/IO/BufferWithOwnMemory.h:50: DB::Memory<Allocator<false, false>>::Memory(unsigned long, unsigned long) @ 0x000000001335e720
13. /build/src/IO/BufferWithOwnMemory.h:157: DB::BufferWithOwnMemory<DB::WriteBuffer>::BufferWithOwnMemory(unsigned long, char*, unsigned long) @ 0x000000001338b815
14. /build/src/IO/WriteBufferFromFileBase.cpp:7: DB::WriteBufferFromFileBase::WriteBufferFromFileBase(unsigned long, char*, unsigned long) @ 0x000000001338b771
15. /build/src/IO/WriteBufferFromFileDescriptor.cpp:98: DB::WriteBufferFromFileDescriptor::WriteBufferFromFileDescriptor(int, unsigned long, char*, std::shared_ptr<DB::Throttler>, unsigned long, String) @ 0x000000001338ae24
16. /build/src/IO/WriteBufferFromFile.cpp:36: DB::WriteBufferFromFile::WriteBufferFromFile(String const&, unsigned long, int, std::shared_ptr<DB::Throttler>, unsigned int, char*, unsigned long) @ 0x000000001352961c
17. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::WriteBufferFromFile>::__unique_single std::make_unique[abi:v15000]<DB::WriteBufferFromFile, String const&>(String const&) @ 0x00000000136b1027
18. /build/src/Interpreters/Cache/FileSegment.cpp:387: DB::FileSegment::write(char const*, unsigned long, unsigned long) @ 0x000000001bc9b814
19. /build/src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:769: DB::CachedOnDiskReadBufferFromFile::writeCache(char*, unsigned long, unsigned long, DB::FileSegment&) @ 0x000000001933db8e
20. /build/src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:1001: DB::CachedOnDiskReadBufferFromFile::nextImplStep() @ 0x00000000193415c9
21. /build/src/Disks/IO/CachedOnDiskReadBufferFromFile.cpp:795: DB::CachedOnDiskReadBufferFromFile::nextImpl() @ 0x000000001933e9b9
22. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5da6a
23. /build/src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:209: DB::ReadBufferFromRemoteFSGather::readImpl() @ 0x000000001932ec9a
24. /build/src/Disks/IO/ReadBufferFromRemoteFSGather.cpp:181: DB::ReadBufferFromRemoteFSGather::nextImpl() @ 0x000000001932ebdb
25. /build/src/IO/ReadBuffer.h:70: DB::ReadBuffer::next() @ 0x000000000af5da6a
26. /build/src/IO/ReadBuffer.h:106: DB::CompressedReadBufferBase::readCompressedDataBlockForAsynchronous(unsigned long&, unsigned long&) @ 0x0000000019dd9bb8
27. /build/src/Compression/CompressedReadBufferFromFile.cpp:108: DB::CompressedReadBufferFromFile::readBig(char*, unsigned long) @ 0x0000000019ddb52e
28. /build/src/DataTypes/Serializations/SerializationNumber.cpp:221: DB::SerializationNumber<int>::deserializeBinaryBulk(DB::IColumn&, DB::ReadBuffer&, unsigned long, double) const @ 0x000000001a032bba
29. /build/src/DataTypes/Serializations/ISerialization.cpp:146: DB::ISerialization::deserializeBinaryBulkWithMultipleStreams(COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, DB::ISerialization::DeserializeBinaryBulkSettings&, std::shared_ptr<DB::ISerialization::DeserializeBinaryBulkState>&, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>*) const @ 0x0000000019fcf81a
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:363: DB::MergeTreeReaderWide::readData(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn>&, unsigned long, bool, unsigned long, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&, bool) @ 0x000000001ce6a40c
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:151: DB::MergeTreeReaderWide::readRows(unsigned long, unsigned long, bool, unsigned long, std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>&) @ 0x000000001ce69de7

2025.03.05 22:42:51.376473 [ 9875 ] {bdafe353-a28a-4a59-859a-617b613d3a7b} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=962, jobs=859). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46576) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:42:51.472136 [ 9875 ] {bdafe353-a28a-4a59-859a-617b613d3a7b} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=962, jobs=859). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:42:54.440129 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/vyl/xobhweljlbjiuruhseuotdjzqawpj, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 85ec4563-f33a-45c0-9c25-7215d2e809fa, upload has finished false.
2025.03.05 22:42:54.451034 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/vyl/xobhweljlbjiuruhseuotdjzqawpj, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 85ec4563-f33a-45c0-9c25-7215d2e809fa, upload has finished false
2025.03.05 22:42:54.513125 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/vyl/xobhweljlbjiuruhseuotdjzqawpj, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 85ec4563-f33a-45c0-9c25-7215d2e809fa, upload has finished false
2025.03.05 22:42:54.652295 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 23 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:56.931201 [ 9184 ] {631ffea8-10cc-4df7-9e2c-9ad67992613c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:57680) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:42:56.961083 [ 9184 ] {631ffea8-10cc-4df7-9e2c-9ad67992613c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:42:57.868870 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:42:58.357475 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {388a668d-c3ee-4b85-bfa8-acb99b8c5d8d::202503_1_72_14}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:00.370662 [ 9877 ] {f9168429-e0ba-488a-aee9-b4f291f7fba8} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:57700) (comment: 02122_parallel_formatting_Pretty.sh) (in query: select number, number + 1, concat('string: ', toString(number)) from numbers(200000) group by number with totals order by number limit 190000 format Pretty), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:00.456246 [ 9877 ] {f9168429-e0ba-488a-aee9-b4f291f7fba8} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:01.432354 [ 3610 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:02.116812 [ 9184 ] {c4d078db-5e75-49a9-896a-aebde18036d0} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=32, jobs=32). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:57708) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:02.218558 [ 9184 ] {c4d078db-5e75-49a9-896a-aebde18036d0} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=32, jobs=32). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:02.267854 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:03.876109 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:04.404341 [ 9875 ] {6837d683-ad83-4ec9-83ba-5005aff3e3a4} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=3, jobs=3): while pushing to view test_9.wv (0745b061-58f7-49bd-817a-9cb1a1375922). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:57670) (comment: 01088_window_view_default_column.sh) (in query: INSERT INTO mt VALUES ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:04.532313 [ 9875 ] {6837d683-ad83-4ec9-83ba-5005aff3e3a4} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=3, jobs=3): while pushing to view test_9.wv (0745b061-58f7-49bd-817a-9cb1a1375922). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:05.889885 [ 3633 ] {} <Error> void DB::SystemLog<DB::TraceLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:08.332104 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/zog/gkhhxyubavmvxcyiovmbqkzzsulef, total size 184549376, count 184549376, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 177364a4-6cb6-48c3-81ee-6f44a70a1e81, upload has finished false.
2025.03.05 22:43:08.339852 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/zog/gkhhxyubavmvxcyiovmbqkzzsulef, total size 184549376, count 184549376, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 177364a4-6cb6-48c3-81ee-6f44a70a1e81, upload has finished false
2025.03.05 22:43:08.417809 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/zog/gkhhxyubavmvxcyiovmbqkzzsulef, total size 184549376, count 184549376, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 177364a4-6cb6-48c3-81ee-6f44a70a1e81, upload has finished false
2025.03.05 22:43:08.582422 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=36, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 40 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:09.072487 [ 9184 ] {7c500144-735b-4d6f-a9e5-e5f7117d6b98} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55290) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:09.131824 [ 9184 ] {7c500144-735b-4d6f-a9e5-e5f7117d6b98} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:10.916558 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {388a668d-c3ee-4b85-bfa8-acb99b8c5d8d::202503_1_72_14}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:12.282436 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:12.368188 [ 9178 ] {d24b6548-9671-4118-8c61-6bef718f4054} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55324) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:12.408501 [ 9178 ] {d24b6548-9671-4118-8c61-6bef718f4054} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:14.146552 [ 3923 ] {f9f528b5-f582-46b4-a20b-9873feb20b83} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=37, jobs=37). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46584) (comment: 00043_any_left_join.sql) (in query: SELECT EventDate, count() AS hits, any(visits) FROM test.hits ANY LEFT JOIN ( SELECT StartDate AS EventDate, sum(Sign) AS visits FROM test.visits GROUP BY EventDate ) USING EventDate GROUP BY EventDate ORDER BY hits DESC LIMIT 10 SETTINGS joined_subquery_requires_alias = 0;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:14.333900 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:15.331281 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 10 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:16.321098 [ 5724 ] {5f4a58ef-a521-451a-be1e-36071b948d0a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=22): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46546) (comment: 00172_hits_joins.gen.sql) (in query: SELECT EventDate, count() AS hits, any(visits) FROM test.hits ANY LEFT JOIN ( SELECT StartDate AS EventDate, sum(Sign) AS visits FROM test.visits GROUP BY EventDate ) USING EventDate GROUP BY EventDate ORDER BY hits DESC LIMIT 10 SETTINGS joined_subquery_requires_alias = 0;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:43:17.296044 [ 5724 ] {5f4a58ef-a521-451a-be1e-36071b948d0a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=22): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:43:17.334821 [ 9178 ] {fb0288de-4fc6-4a18-b183-40190ebd45b2} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=10). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39930) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:17.371252 [ 9178 ] {fb0288de-4fc6-4a18-b183-40190ebd45b2} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=10, jobs=10). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:19.282440 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:19.403679 [ 3923 ] {f9f528b5-f582-46b4-a20b-9873feb20b83} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=37, jobs=37). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:19.551766 [ 3780 ] {2b134964-1ec3-4be4-8143-93b84349cdc9} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39940) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:19.610101 [ 3780 ] {2b134964-1ec3-4be4-8143-93b84349cdc9} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:21.820290 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/fcb/xkffeseutqnvcmftffkcymfkhdihq, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 602f3f7f-3920-4d0f-a636-9e2dd7825b5b, upload has finished false.
2025.03.05 22:43:21.821293 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/fcb/xkffeseutqnvcmftffkcymfkhdihq, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 602f3f7f-3920-4d0f-a636-9e2dd7825b5b, upload has finished false
2025.03.05 22:43:21.847034 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/fcb/xkffeseutqnvcmftffkcymfkhdihq, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 602f3f7f-3920-4d0f-a636-9e2dd7825b5b, upload has finished false
2025.03.05 22:43:22.004347 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 13 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:22.383011 [ 3553 ] {b5c1a781-0b5c-4dfb-bb23-0f220cedfbbd::all_1_8_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/nnd/vuuuaghmwgdmcgscgipghckccffqy, total size 419430400, count 419430400, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id fc085e2e-b6c6-4480-bdb3-8e7de44dc0e7, upload has finished false.
2025.03.05 22:43:22.385350 [ 3553 ] {b5c1a781-0b5c-4dfb-bb23-0f220cedfbbd::all_1_8_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/nnd/vuuuaghmwgdmcgscgipghckccffqy, total size 419430400, count 419430400, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id fc085e2e-b6c6-4480-bdb3-8e7de44dc0e7, upload has finished false
2025.03.05 22:43:22.528956 [ 3553 ] {b5c1a781-0b5c-4dfb-bb23-0f220cedfbbd::all_1_8_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/nnd/vuuuaghmwgdmcgscgipghckccffqy, total size 419430400, count 419430400, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id fc085e2e-b6c6-4480-bdb3-8e7de44dc0e7, upload has finished false
2025.03.05 22:43:22.575770 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {b5c1a781-0b5c-4dfb-bb23-0f220cedfbbd::all_1_8_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:567: DB::WriteBufferFromS3::writePart(DB::WriteBufferFromS3::PartData&&) @ 0x000000001991336e
18. /build/src/IO/WriteBufferFromS3.cpp:370: DB::WriteBufferFromS3::writeMultipartUpload() @ 0x00000000199074b6
19. /build/src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::nextImpl() @ 0x0000000019906b7e
20. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
21. /build/src/IO/WriteBufferFromFileDecorator.cpp:71: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x000000001a3579ad
22. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
23. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
24. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
25. /build/src/IO/WriteBuffer.h:76: DB::WriteBuffer::nextIfAtEnd() @ 0x000000000a92ff78
26. /build/src/IO/WriteBuffer.h:91: DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000a92fde0
27. /build/src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x0000000019ddbded
28. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
29. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
30. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
31. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:237: DB::MergeTreeDataPartWriterCompact::writeDataBlock(DB::Block const&, std::vector<DB::Granule, std::allocator<DB::Granule>> const&) @ 0x000000001ccd146e
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:22.715414 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:25.927307 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 7 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:28.142490 [ 3610 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:29.275732 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {0d6617f8-564f-43ff-a6dc-a74b9f150261::202503_1_104_19}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=2): (while reading column trace): (while reading from part /var/lib/clickhouse/disks/s3/store/0d6/0d6617f8-564f-43ff-a6dc-a74b9f150261/202503_1_99_18/ in table system.trace_log (0d6617f8-564f-43ff-a6dc-a74b9f150261) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 8192): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/SerializationArray.cpp:259: DB::SerializationArray::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fdf50e
30. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:29.547207 [ 9183 ] {930cfd3b-95ef-404f-82b8-495721979ba4} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=41, jobs=41). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55350) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:29.624385 [ 9183 ] {930cfd3b-95ef-404f-82b8-495721979ba4} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=41, jobs=41). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:30.411137 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:31.903000 [ 9181 ] {56062101-81a3-4796-9da9-104d4370cb31} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55326) (comment: 01761_alter_decimal_zookeeper_long.sql) (in query: SELECT * FROM test_alter_decimal ORDER BY n;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:43:31.944083 [ 9181 ] {56062101-81a3-4796-9da9-104d4370cb31} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:43:33.670920 [ 3780 ] {2eb4ea94-b992-48b8-84e8-6342bce7d13d} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=3): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39958) (comment: 00011_sorting.sql) (in query: SELECT EventTime::DateTime('Asia/Dubai') FROM test.hits ORDER BY EventTime DESC LIMIT 10 ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:43:34.832865 [ 9181 ] {e98a401a-268e-429b-b370-e72259c53c8e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43234) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:34.886798 [ 9181 ] {e98a401a-268e-429b-b370-e72259c53c8e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:36.270804 [ 3780 ] {2eb4ea94-b992-48b8-84e8-6342bce7d13d} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=3): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:43:38.902530 [ 3550 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/ryc/wcvdipfunohojzzkqxibmtaxvkefm, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e9aeee2f-2ee2-4582-b0de-31314f60db6a, upload has finished false.
2025.03.05 22:43:38.903418 [ 3550 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/ryc/wcvdipfunohojzzkqxibmtaxvkefm, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e9aeee2f-2ee2-4582-b0de-31314f60db6a, upload has finished false
2025.03.05 22:43:39.010784 [ 3550 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/ryc/wcvdipfunohojzzkqxibmtaxvkefm, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e9aeee2f-2ee2-4582-b0de-31314f60db6a, upload has finished false
2025.03.05 22:43:39.085908 [ 3550 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 19 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:39.139741 [ 3780 ] {51e2ac7c-b175-40bf-8fc5-4926daf48989} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=38, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43266) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:39.171124 [ 3780 ] {51e2ac7c-b175-40bf-8fc5-4926daf48989} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=38, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:39.619355 [ 9178 ] {84a103ea-3efe-47a7-8f9a-fa6c705711cd} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=6): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43250) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: SELECT if((countDistinct(data) as c) == 0, 1, c) FROM ( SELECT _table, (count(), sum(key), sum(cityHash64(value0))) AS data FROM merge(currentDatabase(), 'concurrent_alter_add_drop_steroids_') GROUP BY _table )), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:43:39.909102 [ 9877 ] {44c0efa1-d52d-43d1-bd3d-d5603bbcf5f3} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43268) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:40.002219 [ 9877 ] {44c0efa1-d52d-43d1-bd3d-d5603bbcf5f3} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:40.189189 [ 9178 ] {84a103ea-3efe-47a7-8f9a-fa6c705711cd} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=6): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:43:40.616543 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:42.828895 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:43.677325 [ 9877 ] {97aea5bf-40db-4c21-a5bc-41aeffbb9845} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=28, jobs=28). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43274) (comment: 00014_filtering_arrays.sql) (in query: SELECT GeneralInterests FROM test.hits WHERE AdvEngineID != 0 ORDER BY GeneralInterests DESC LIMIT 10 ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:44.198996 [ 9183 ] {4af53fba-813f-46aa-9e10-f730b01f03ad} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=22, jobs=22). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36616) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:44.348164 [ 9183 ] {4af53fba-813f-46aa-9e10-f730b01f03ad} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=22, jobs=22). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:44.686274 [ 9178 ] {86f81250-c38b-4466-8380-b607e6067a00} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36602) (comment: 00176_distinct_limit_by_limit_bug_43377.sql) (in query: SELECT count() FROM ( SELECT DISTINCT Title, SearchPhrase FROM test.hits WHERE (SearchPhrase != '') AND (NOT match(Title, '[а-яА-ЯёЁ]')) AND (NOT match(SearchPhrase, '[а-яА-ЯёЁ]')) LIMIT 1 BY Title LIMIT 10 );), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:44.885452 [ 9178 ] {86f81250-c38b-4466-8380-b607e6067a00} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:45.441381 [ 8742 ] {b208af90-7f8d-4e23-89aa-e0d53d5783cc} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36626) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:45.471208 [ 8742 ] {b208af90-7f8d-4e23-89aa-e0d53d5783cc} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:46.027881 [ 9877 ] {97aea5bf-40db-4c21-a5bc-41aeffbb9845} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=28, jobs=28). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:49.065872 [ 9184 ] {cf4c673c-3194-40fe-befb-7b4e009c1e99} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36650) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:49.090712 [ 9184 ] {cf4c673c-3194-40fe-befb-7b4e009c1e99} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:50.317483 [ 9184 ] {f7549a10-4379-414f-819b-7c8aae303755} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=32, jobs=32). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36690) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:50.352841 [ 9184 ] {f7549a10-4379-414f-819b-7c8aae303755} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=32, jobs=32). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:53.098018 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/chi/dmqzwivyiycixqiixlyanozwftlux, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 91617c4e-acc1-467a-8500-04e9c4cf31a0, upload has finished false.
2025.03.05 22:43:53.107609 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/chi/dmqzwivyiycixqiixlyanozwftlux, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 91617c4e-acc1-467a-8500-04e9c4cf31a0, upload has finished false
2025.03.05 22:43:53.183582 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/chi/dmqzwivyiycixqiixlyanozwftlux, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 91617c4e-acc1-467a-8500-04e9c4cf31a0, upload has finished false
2025.03.05 22:43:53.259284 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 39 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:53.761840 [ 5724 ] {4f4e2417-a2fd-4c4d-b94f-9fbe0b99b15e} <Error> executeQuery: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 117.52 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED) (version 24.3.12.76.altinitystable) (from [::1]:36658) (comment: 00078_group_by_arrays.sql) (in query: SELECT GoalsReached AS k, count() AS c FROM test.hits GROUP BY k ORDER BY c DESC LIMIT 10;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000132e9d7a
6. /build/src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e7feb
7. /build/src/Common/MemoryTracker.cpp:398: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e8862
8. /build/src/Common/CurrentMemoryTracker.cpp:84: CurrentMemoryTracker::check() @ 0x00000000132556b9
9. /build/src/Interpreters/Aggregator.cpp:1859: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000001a720cb7
10. /build/src/Interpreters/Aggregator.cpp:1645: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x000000001a730a9c
11. /build/src/Processors/Transforms/AggregatingTransform.cpp:692: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000001dc97133
12. /build/src/Processors/Transforms/AggregatingTransform.cpp:651: DB::AggregatingTransform::work() @ 0x000000001dc94239
13. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d5329e3
14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d532720
15. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514ca1
16. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
17. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
27. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
28. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
29. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935

2025.03.05 22:43:54.364206 [ 8742 ] {454fda79-74ee-4be8-b3f6-777d359f5b77} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=969, jobs=880). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:36674) (comment: 00088_global_in_one_shard_and_rows_before_limit.sql) (in query: SELECT EventDate, count() FROM remote('127.0.0.1', test.hits) WHERE UserID GLOBAL IN (SELECT UserID FROM test.hits) GROUP BY EventDate ORDER BY EventDate LIMIT 5 FORMAT JSONCompact;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:43:54.433229 [ 8742 ] {454fda79-74ee-4be8-b3f6-777d359f5b77} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=969, jobs=880). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:43:55.846214 [ 8742 ] {c829d674-0c01-4254-97d7-f0f67b7ee22a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38864) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:55.869310 [ 8742 ] {c829d674-0c01-4254-97d7-f0f67b7ee22a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=8, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:56.056626 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38ea0
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:57.713291 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:43:58.668642 [ 8742 ] {7f87e129-7f5e-4a9c-9d9f-b5e9b1db8530} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38880) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: SELECT COUNT() FROM system.replication_queue WHERE table = 'concurrent_alter_add_drop_steroids_1'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:59.060381 [ 8742 ] {7f87e129-7f5e-4a9c-9d9f-b5e9b1db8530} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:43:59.722665 [ 3923 ] {76764912-0066-4ac6-bae3-f8ca2c1c0c42} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38904) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:59.740457 [ 3923 ] {76764912-0066-4ac6-bae3-f8ca2c1c0c42} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:43:59.801520 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:00.864996 [ 8742 ] {aeb8cbaf-21e9-4db7-a0d4-4e6c91b6dfb8} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38906) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:44:01.022266 [ 8742 ] {aeb8cbaf-21e9-4db7-a0d4-4e6c91b6dfb8} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:44:02.008605 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:02.329929 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/qhy/nzetvhdwyfgqoctnyhckjudmahnxu, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 069cce71-7c1d-4efc-a399-5a20bccfc9a1, upload has finished false.
2025.03.05 22:44:02.330644 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/qhy/nzetvhdwyfgqoctnyhckjudmahnxu, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 069cce71-7c1d-4efc-a399-5a20bccfc9a1, upload has finished false
2025.03.05 22:44:02.382201 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/qhy/nzetvhdwyfgqoctnyhckjudmahnxu, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 069cce71-7c1d-4efc-a399-5a20bccfc9a1, upload has finished false
2025.03.05 22:44:02.554953 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 22 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:02.733743 [ 9877 ] {e9e91677-3fbe-4ded-bad4-73f9575bcf33} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:59250) (comment: 00012_sorting_distributed.sql) (in query: SELECT CAST(`__table1`.`EventTime`, 'DateTime(\'Asia/Dubai\')') AS `CAST(EventTime, 'DateTime(\\'Asia/Dubai\\')')` FROM `test`.`hits` AS `__table1` ORDER BY `__table1`.`EventTime` DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:44:03.054461 [ 5724 ] {4f4e2417-a2fd-4c4d-b94f-9fbe0b99b15e} <Error> TCPHandler: Code: 241. DB::Exception: Memory tracker (for query): fault injected. Would use 117.52 MiB (attempt to allocate chunk of 0 bytes), maximum: 9.31 GiB: While executing AggregatingTransform. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*, String, long&, String>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type, std::type_identity<String>::type, std::type_identity<long&>::type, std::type_identity<String>::type>, char const*&&, char const*&&, String&&, long&, String&&) @ 0x00000000132e9d7a
6. /build/src/Common/MemoryTracker.cpp:281: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e7feb
7. /build/src/Common/MemoryTracker.cpp:398: MemoryTracker::allocImpl(long, bool, MemoryTracker*, double) @ 0x00000000132e8862
8. /build/src/Common/CurrentMemoryTracker.cpp:84: CurrentMemoryTracker::check() @ 0x00000000132556b9
9. /build/src/Interpreters/Aggregator.cpp:1859: DB::Aggregator::checkLimits(unsigned long, bool&) const @ 0x000000001a720cb7
10. /build/src/Interpreters/Aggregator.cpp:1645: DB::Aggregator::executeOnBlock(std::vector<COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>, unsigned long, unsigned long, DB::AggregatedDataVariants&, std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>&, std::vector<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>, std::allocator<std::vector<DB::IColumn const*, std::allocator<DB::IColumn const*>>>>&, bool&) const @ 0x000000001a730a9c
11. /build/src/Processors/Transforms/AggregatingTransform.cpp:692: DB::AggregatingTransform::consume(DB::Chunk) @ 0x000000001dc97133
12. /build/src/Processors/Transforms/AggregatingTransform.cpp:651: DB::AggregatingTransform::work() @ 0x000000001dc94239
13. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000001d5329e3
14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:95: DB::ExecutionThreadContext::executeTask() @ 0x000000001d532720
15. /build/src/Processors/Executors/PipelineExecutor.cpp:273: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514ca1
16. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
17. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
27. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
28. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
29. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935

2025.03.05 22:44:03.206374 [ 9877 ] {e9e91677-3fbe-4ded-bad4-73f9575bcf33} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:44:07.862559 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/ijs/utgumekgeaickfnyqblfoxnwdnnxk, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 26b09a9b-67f3-4b2b-a4f2-2cad8068ab32, upload has finished false.
2025.03.05 22:44:07.865185 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/ijs/utgumekgeaickfnyqblfoxnwdnnxk, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 26b09a9b-67f3-4b2b-a4f2-2cad8068ab32, upload has finished false
2025.03.05 22:44:07.902215 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/ijs/utgumekgeaickfnyqblfoxnwdnnxk, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 26b09a9b-67f3-4b2b-a4f2-2cad8068ab32, upload has finished false
2025.03.05 22:44:07.985154 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 13 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:09.409061 [ 9184 ] {1fd73195-ceb2-499b-a1e3-56762fb31faf} <Error> executeQuery: Code: 439. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). Stack trace:

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850
: While executing Remote. (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38894) (comment: 00012_sorting_distributed.sql) (in query: SELECT EventTime::DateTime('Asia/Dubai') FROM remote('127.0.0.{1,2}', test, hits) ORDER BY EventTime DESC LIMIT 10 ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a941aaa
5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a941a55
6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013368d82
7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bca59
8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c3fb1
9. /build/src/Client/PacketReceiver.cpp:66: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000001d330ea4
10. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000019ebcc69
11. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>::operator()(boost::context::fiber&&) @ 0x0000000019ebcb78
12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebcb08
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebcac8
14. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run(void*) @ 0x0000000019ebc9fe
15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry<boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(boost::context::detail::transfer_t) @ 0x0000000019ebc71d

2025.03.05 22:44:09.438407 [ 9184 ] {1fd73195-ceb2-499b-a1e3-56762fb31faf} <Error> TCPHandler: Code: 439. DB::Exception: Received from 127.0.0.2:9000. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). Stack trace:

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850
: While executing Remote. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:89: DB::Exception::Exception(String const&, int, bool) @ 0x000000000a941aaa
5. /build/src/Common/Exception.h:97: DB::Exception::createDeprecated(String const&, int, bool) @ 0x000000000a941a55
6. /build/src/IO/ReadHelpers.cpp:1560: DB::readException(DB::ReadBuffer&, String const&, bool) @ 0x0000000013368d82
7. /build/src/Client/Connection.cpp:1233: DB::Connection::receiveException() const @ 0x000000001d2bca59
8. /build/src/Client/Connection.cpp:1070: DB::Connection::receivePacket() @ 0x000000001d2c3fb1
9. /build/src/Client/PacketReceiver.cpp:66: DB::PacketReceiver::Task::run(std::function<void (int, Poco::Timespan, DB::AsyncEventTimeoutType, String const&, unsigned int)>, std::function<void ()>) @ 0x000000001d330ea4
10. /build/src/Common/AsyncTaskExecutor.cpp:88: DB::AsyncTaskExecutor::Routine::operator()(std::function<void ()>) @ 0x0000000019ebcc69
11. /build/src/Common/Fiber.h:76: Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>::operator()(boost::context::fiber&&) @ 0x0000000019ebcb78
12. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019ebcb08
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:531: ? @ 0x0000000019ebcac8
14. /build/contrib/boost/boost/context/fiber_fcontext.hpp:157: boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>::run(void*) @ 0x0000000019ebc9fe
15. /build/contrib/boost/boost/context/fiber_fcontext.hpp:97: void boost::context::detail::fiber_entry<boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, Fiber::RoutineImpl<DB::AsyncTaskExecutor::Routine>>>(boost::context::detail::transfer_t) @ 0x0000000019ebc71d

2025.03.05 22:44:09.498373 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:10.970765 [ 9875 ] {a2623f68-4a80-4d16-b553-622adada1d44} <Error> executeQuery: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:55430). (NETWORK_ERROR) (version 24.3.12.76.altinitystable) (from [::ffff:127.0.0.1]:55430) (comment: 00012_sorting_distributed.sql) (in query: SELECT CAST(`__table1`.`EventTime`, 'DateTime(\'Asia/Dubai\')') AS `CAST(EventTime, 'DateTime(\\'Asia/Dubai\\')')` FROM `test`.`hits` AS `__table1` ORDER BY `__table1`.`EventTime` DESC LIMIT _CAST(10, 'UInt64')), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e7844
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Server/TCPHandler.cpp:2301: DB::TCPHandler::sendProgress() @ 0x000000001d47a19d
9. /build/src/Server/TCPHandler.cpp:1088: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47a01b
10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:44:10.972130 [ 9184 ] {304cadbf-d4d5-481f-931b-cdfca7cc5040} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53646) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:44:11.030304 [ 9184 ] {304cadbf-d4d5-481f-931b-cdfca7cc5040} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:44:11.318260 [ 3923 ] {f6546901-35eb-4512-9817-95cb8b586944} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=11): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53628) (comment: 00079_array_join_not_used_joined_column.sql) (in query: SELECT PP.Key1 AS `ym:s:paramsLevel1`, sum(arrayAll(`x_1` -> `x_1`= '', ParsedParams.Key2)) AS `ym:s:visits` FROM test.hits ARRAY JOIN ParsedParams AS `PP` WHERE CounterID = 1704509 GROUP BY `ym:s:paramsLevel1` ORDER BY PP.Key1, `ym:s:visits` LIMIT 0, 100;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:44:11.327811 [ 9877 ] {ab39e858-286c-4cdc-bdb9-a24c22d90f7e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53660) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:44:11.384015 [ 9877 ] {ab39e858-286c-4cdc-bdb9-a24c22d90f7e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:44:11.627863 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:11.718216 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column Referer): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_2_2_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6592): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:12.007375 [ 9875 ] {a2623f68-4a80-4d16-b553-622adada1d44} <Error> TCPHandler: Can't send logs to client: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:55430). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e7844
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Server/TCPHandler.cpp:2253: DB::TCPHandler::sendLogData(DB::Block const&) @ 0x000000001d485e55
9. /build/src/Server/TCPHandler.cpp:2330: DB::TCPHandler::sendLogs() @ 0x000000001d47abff
10. /build/src/Server/TCPHandler.cpp:693: DB::TCPHandler::runImpl() @ 0x000000001d4700c2
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:12.024007 [ 9875 ] {a2623f68-4a80-4d16-b553-622adada1d44} <Error> TCPHandler: Code: 210. DB::NetException: I/O error: Broken pipe, while writing to socket ([::ffff:127.0.0.1]:9000 -> [::ffff:127.0.0.1]:55430). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/NetException.h:26: DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x00000000134e8348
6. /build/src/IO/WriteBufferFromPocoSocket.cpp:169: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x00000000134e7844
7. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
8. /build/src/Server/TCPHandler.cpp:2301: DB::TCPHandler::sendProgress() @ 0x000000001d47a19d
9. /build/src/Server/TCPHandler.cpp:1088: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d47a01b
10. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
11. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
12. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
13. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
14. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
15. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
16. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
17. ? @ 0x00007f7a996d8ac3
18. ? @ 0x00007f7a9976a850

2025.03.05 22:44:12.080162 [ 3610 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:12.085419 [ 9875 ] {a2623f68-4a80-4d16-b553-622adada1d44} <Warning> TCPHandler: Client has gone away.
2025.03.05 22:44:12.375951 [ 3923 ] {f6546901-35eb-4512-9817-95cb8b586944} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=11): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:44:14.532770 [ 3923 ] {0690e62f-a9d3-405b-812f-706e7486a9fc} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48054) (comment: 00055_index_and_not.sql) (in query: SELECT count() FROM test.hits WHERE NOT (EventDate >= toDate('2015-01-01') AND EventDate < toDate('2015-02-01')) ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:44:14.565822 [ 3923 ] {0690e62f-a9d3-405b-812f-706e7486a9fc} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp:748: DB::MergeTreeDataSelectExecutor::filterPartsByPrimaryKeyAndSkipIndexes(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>&&, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>&&, std::shared_ptr<DB::StorageInMemoryMetadata const>, std::shared_ptr<DB::Context const> const&, DB::KeyCondition const&, std::optional<DB::KeyCondition> const&, DB::UsefulSkipIndexes const&, DB::MergeTreeReaderSettings const&, std::shared_ptr<Poco::Logger>, unsigned long, std::vector<DB::ReadFromMergeTree::IndexStat, std::allocator<DB::ReadFromMergeTree::IndexStat>>&, bool) @ 0x000000001cd0ef35
10. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1671: DB::ReadFromMergeTree::selectRangesToReadImpl(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5d9c4
11. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1570: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, std::shared_ptr<DB::Context const>, unsigned long, std::shared_ptr<std::unordered_map<String, long, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, long>>>>, DB::MergeTreeData const&, std::vector<String, std::allocator<String>> const&, std::shared_ptr<Poco::Logger>, std::optional<DB::ReadFromMergeTree::Indexes>&) @ 0x000000001dd5a66f
12. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1371: DB::ReadFromMergeTree::selectRangesToRead(std::vector<std::shared_ptr<DB::IMergeTreeDataPart const>, std::allocator<std::shared_ptr<DB::IMergeTreeDataPart const>>>, std::vector<std::shared_ptr<DB::AlterConversions const>, std::allocator<std::shared_ptr<DB::AlterConversions const>>>) const @ 0x000000001dd5a49e
13. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1854: DB::ReadFromMergeTree::getAnalysisResult() const @ 0x000000001dd6028c
14. /build/src/Processors/QueryPlan/ReadFromMergeTree.cpp:1969: DB::ReadFromMergeTree::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd612fb
15. /build/src/Processors/QueryPlan/ISourceStep.cpp:20: DB::ISourceStep::updatePipeline(std::vector<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>, std::allocator<std::unique_ptr<DB::QueryPipelineBuilder, std::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd07a90
16. /build/src/Processors/QueryPlan/QueryPlan.cpp:188: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x000000001dd3251f
17. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:252: DB::InterpreterSelectQueryAnalyzer::buildQueryPipeline() @ 0x000000001b507541
18. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:221: DB::InterpreterSelectQueryAnalyzer::execute() @ 0x000000001b50729b
19. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
20. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
21. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
22. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
23. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
24. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
25. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
26. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
27. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
28. ? @ 0x00007f7a996d8ac3
29. ? @ 0x00007f7a9976a850

2025.03.05 22:44:15.606769 [ 5724 ] {bbb2301e-383b-4102-9be7-1ab1279e1b0c} <Error> executeQuery: Code: 10. DB::Exception: Not found column key2: in block __table1.key String String(size = 0). (NOT_FOUND_COLUMN_IN_BLOCK) (version 24.3.12.76.altinitystable) (from [::1]:53618) (comment: 01881_join_on_conditions_hash.gen.sql) (in query: SELECT t1.key FROM t1 INNER ANY JOIN t2 ON t1.id == t2.id AND t2.key == t2.key2 AND t1.key == t1.key2 AND 0;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a941e33
6. /build/src/Interpreters/ActionsDAG.cpp:824: DB::ActionsDAG::evaluatePartialResult(std::unordered_map<DB::ActionsDAG::Node const*, DB::ColumnWithTypeAndName, std::hash<DB::ActionsDAG::Node const*>, std::equal_to<DB::ActionsDAG::Node const*>, std::allocator<std::pair<DB::ActionsDAG::Node const* const, DB::ColumnWithTypeAndName>>>&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>> const&, unsigned long, bool) @ 0x000000001a43aaf9
7. /build/src/Interpreters/ActionsDAG.cpp:739: DB::ActionsDAG::updateHeader(DB::Block) const @ 0x000000001a43a080
8. /build/src/Processors/Transforms/ExpressionTransform.cpp:8: DB::ExpressionTransform::transformHeader(DB::Block, DB::ActionsDAG const&) @ 0x000000001da40fd1
9. /build/src/Processors/QueryPlan/ExpressionStep.cpp:31: DB::ExpressionStep::ExpressionStep(DB::DataStream const&, std::shared_ptr<DB::ActionsDAG> const&) @ 0x000000001dce3f26
10. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::ExpressionStep>::__unique_single std::make_unique[abi:v15000]<DB::ExpressionStep, DB::DataStream const&, std::shared_ptr<DB::ActionsDAG>&>(DB::DataStream const&, std::shared_ptr<DB::ActionsDAG>&) @ 0x00000000190c94f1
11. /build/src/Planner/PlannerJoinTree.cpp:1122: DB::(anonymous namespace)::buildQueryPlanForJoinNode(std::shared_ptr<DB::IQueryTreeNode> const&, DB::JoinTreeQueryPlan, DB::JoinTreeQueryPlan, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&, std::shared_ptr<DB::PlannerContext>&) @ 0x000000001b554cc9
12. /build/src/Planner/PlannerJoinTree.cpp:1721: DB::buildJoinTreeQueryPlan(std::shared_ptr<DB::IQueryTreeNode> const&, DB::SelectQueryInfo const&, DB::SelectQueryOptions&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&, std::shared_ptr<DB::PlannerContext>&) @ 0x000000001b54dac5
13. /build/src/Planner/Planner.cpp:1473: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50e306
14. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50a455
15. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50765d
16. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0e12
17. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
18. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
19. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
20. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
21. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
22. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
23. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
24. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
25. ? @ 0x00007f7a996d8ac3
26. ? @ 0x00007f7a9976a850

2025.03.05 22:44:15.616970 [ 5724 ] {bbb2301e-383b-4102-9be7-1ab1279e1b0c} <Error> TCPHandler: Code: 10. DB::Exception: Not found column key2: in block __table1.key String String(size = 0). (NOT_FOUND_COLUMN_IN_BLOCK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type>, String const&) @ 0x000000000a941e33
6. /build/src/Interpreters/ActionsDAG.cpp:824: DB::ActionsDAG::evaluatePartialResult(std::unordered_map<DB::ActionsDAG::Node const*, DB::ColumnWithTypeAndName, std::hash<DB::ActionsDAG::Node const*>, std::equal_to<DB::ActionsDAG::Node const*>, std::allocator<std::pair<DB::ActionsDAG::Node const* const, DB::ColumnWithTypeAndName>>>&, std::vector<DB::ActionsDAG::Node const*, std::allocator<DB::ActionsDAG::Node const*>> const&, unsigned long, bool) @ 0x000000001a43aaf9
7. /build/src/Interpreters/ActionsDAG.cpp:739: DB::ActionsDAG::updateHeader(DB::Block) const @ 0x000000001a43a080
8. /build/src/Processors/Transforms/ExpressionTransform.cpp:8: DB::ExpressionTransform::transformHeader(DB::Block, DB::ActionsDAG const&) @ 0x000000001da40fd1
9. /build/src/Processors/QueryPlan/ExpressionStep.cpp:31: DB::ExpressionStep::ExpressionStep(DB::DataStream const&, std::shared_ptr<DB::ActionsDAG> const&) @ 0x000000001dce3f26
10. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::ExpressionStep>::__unique_single std::make_unique[abi:v15000]<DB::ExpressionStep, DB::DataStream const&, std::shared_ptr<DB::ActionsDAG>&>(DB::DataStream const&, std::shared_ptr<DB::ActionsDAG>&) @ 0x00000000190c94f1
11. /build/src/Planner/PlannerJoinTree.cpp:1122: DB::(anonymous namespace)::buildQueryPlanForJoinNode(std::shared_ptr<DB::IQueryTreeNode> const&, DB::JoinTreeQueryPlan, DB::JoinTreeQueryPlan, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&, std::shared_ptr<DB::PlannerContext>&) @ 0x000000001b554cc9
12. /build/src/Planner/PlannerJoinTree.cpp:1721: DB::buildJoinTreeQueryPlan(std::shared_ptr<DB::IQueryTreeNode> const&, DB::SelectQueryInfo const&, DB::SelectQueryOptions&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>> const&, std::shared_ptr<DB::PlannerContext>&) @ 0x000000001b54dac5
13. /build/src/Planner/Planner.cpp:1473: DB::Planner::buildPlanForQueryNode() @ 0x000000001b50e306
14. /build/src/Planner/Planner.cpp:0: DB::Planner::buildQueryPlanIfNeeded() @ 0x000000001b50a455
15. /build/src/Interpreters/InterpreterSelectQueryAnalyzer.cpp:234: DB::InterpreterSelectQueryAnalyzer::getQueryPlan() @ 0x000000001b50765d
16. /build/src/Interpreters/executeQuery.cpp:1146: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb0e12
17. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
18. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
19. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
20. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
21. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
22. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
23. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
24. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
25. ? @ 0x00007f7a996d8ac3
26. ? @ 0x00007f7a9976a850

2025.03.05 22:44:16.278273 [ 9184 ] {439e2585-79a1-426e-9ce1-c2758efb9df5} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48062) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:44:16.319522 [ 9184 ] {439e2585-79a1-426e-9ce1-c2758efb9df5} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=2, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:44:16.370127 [ 9875 ] {b51db588-d69d-4fa4-824b-d9512b76dee2} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48082) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:44:16.408342 [ 9875 ] {b51db588-d69d-4fa4-824b-d9512b76dee2} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:44:21.363091 [ 9178 ] {ca036c46-54d6-4ee4-8b95-7b888ac88e9d} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48106) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:44:21.420412 [ 9178 ] {ca036c46-54d6-4ee4-8b95-7b888ac88e9d} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=7, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:44:21.692731 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/qkt/qakkhhmwmuyvbzdfyihtmuutoidtx, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id fec2b4c3-154d-47ab-b824-e235c0b5213c, upload has finished false.
2025.03.05 22:44:21.693332 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/qkt/qakkhhmwmuyvbzdfyihtmuutoidtx, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id fec2b4c3-154d-47ab-b824-e235c0b5213c, upload has finished false
2025.03.05 22:44:21.755408 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/qkt/qakkhhmwmuyvbzdfyihtmuutoidtx, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id fec2b4c3-154d-47ab-b824-e235c0b5213c, upload has finished false
2025.03.05 22:44:21.882708 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 36 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:24.265070 [ 5724 ] {25313e49-0bfb-4e63-988f-a718c8124540} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=969, jobs=880). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:53618) (comment: 01881_join_on_conditions_hash.gen.sql) (in query: SELECT DISTINCT t1.id FROM t1 INNER ANY JOIN t2 ON t1.id == t2.id AND toLowCardinality(toNullable(t2.key2 != ''));), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:44:24.304644 [ 5724 ] {25313e49-0bfb-4e63-988f-a718c8124540} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=969, jobs=880). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:44:26.288120 [ 9178 ] {ca1e18be-15b6-4877-9adc-f61f1e8deec7} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42136) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:44:26.396510 [ 9178 ] {ca1e18be-15b6-4877-9adc-f61f1e8deec7} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:44:26.532176 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:274: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf391c4
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:26.949799 [ 3780 ] {ed2ce44e-66c7-4d2f-8202-63bb0aa2e641} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42144) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:44:26.996364 [ 3780 ] {ed2ce44e-66c7-4d2f-8202-63bb0aa2e641} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=12, jobs=12). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:44:27.080309 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=1): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 9 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:30.500072 [ 9877 ] {7aa49001-d471-4fd8-a25f-878a4cac591e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=14): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48092) (comment: 00009_uniq_distributed.sql) (in query: SELECT uniq(UserID), uniqIf(UserID, CounterID = 800784), uniqIf(FUniqID, RegionID = 213) FROM remote('127.0.0.{1,2}', test, hits) ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:44:30.712212 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:31.140848 [ 3780 ] {484c2ef7-d004-40ed-8504-f593a365fac6} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42190) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:44:31.203809 [ 3780 ] {484c2ef7-d004-40ed-8504-f593a365fac6} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:44:32.137583 [ 3780 ] {3c00de2e-6bdc-4176-8f42-4ea0b7b326cc} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42198) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: SELECT COUNT() FROM system.mutations WHERE is_done = 0 and table = 'concurrent_alter_add_drop_steroids_2'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:44:32.246046 [ 3780 ] {3c00de2e-6bdc-4176-8f42-4ea0b7b326cc} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:44:33.619112 [ 9877 ] {7aa49001-d471-4fd8-a25f-878a4cac591e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=14): While executing MergeTreeSelect(pool: ReadPoolInOrder, algorithm: InOrder). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:44:35.548407 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:37.351460 [ 9877 ] {96ac2bdf-7bed-4056-a23a-981e31d9ab7f} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=969, jobs=880). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:43790) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: SELECT * FROM system.mutations WHERE is_done = 0 and table = 'concurrent_alter_add_drop_steroids_2'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:44:37.390036 [ 9877 ] {96ac2bdf-7bed-4056-a23a-981e31d9ab7f} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=969, jobs=880). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:44:38.050430 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:38.102035 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:42.127866 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/vvt/kjrahbjlfwoyzqpqlyyxkvogswqxi, total size 201326592, count 201326592, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 89487cd6-5717-4611-b8b2-104d20ced810, upload has finished false.
2025.03.05 22:44:42.129798 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/vvt/kjrahbjlfwoyzqpqlyyxkvogswqxi, total size 201326592, count 201326592, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 89487cd6-5717-4611-b8b2-104d20ced810, upload has finished false
2025.03.05 22:44:42.197059 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/vvt/kjrahbjlfwoyzqpqlyyxkvogswqxi, total size 201326592, count 201326592, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 89487cd6-5717-4611-b8b2-104d20ced810, upload has finished false
2025.03.05 22:44:42.236394 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:567: DB::WriteBufferFromS3::writePart(DB::WriteBufferFromS3::PartData&&) @ 0x000000001991336e
18. /build/src/IO/WriteBufferFromS3.cpp:370: DB::WriteBufferFromS3::writeMultipartUpload() @ 0x00000000199074b6
19. /build/src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::nextImpl() @ 0x0000000019906b7e
20. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
21. /build/src/IO/WriteBufferFromFileDecorator.cpp:71: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x000000001a3579ad
22. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
23. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
24. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
25. /build/src/IO/WriteBuffer.h:76: DB::WriteBuffer::nextIfAtEnd() @ 0x000000000a92ff78
26. /build/src/IO/WriteBuffer.h:91: DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000a92fde0
27. /build/src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x0000000019ddbded
28. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
29. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
30. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
31. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:350: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ccf3e39
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:42.980172 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:45.906863 [ 3780 ] {0eb06681-d9d6-46d1-b0dd-37d45f87e947} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:49838) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:44:45.964480 [ 3780 ] {0eb06681-d9d6-46d1-b0dd-37d45f87e947} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=36, jobs=36). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:44:46.816022 [ 9877 ] {62480883-065e-4e64-9244-2f7306d31230} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:49828) (comment: 00180_no_seek_avoiding_when_reading_from_cache.sh) (in query: INSERT INTO hits_s3_sampled SELECT * FROM test.hits_s3 SAMPLE 0.01), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:44:47.252982 [ 9877 ] {62480883-065e-4e64-9244-2f7306d31230} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6

2025.03.05 22:44:47.800628 [ 3610 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:49.294609 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/xdb/tyrrfauecmbriaqbbhiocovtfuqmx, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id a74f6ce1-a16e-424b-8c83-553579e860dc, upload has finished false.
2025.03.05 22:44:49.308480 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/xdb/tyrrfauecmbriaqbbhiocovtfuqmx, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id a74f6ce1-a16e-424b-8c83-553579e860dc, upload has finished false
2025.03.05 22:44:49.352502 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/xdb/tyrrfauecmbriaqbbhiocovtfuqmx, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id a74f6ce1-a16e-424b-8c83-553579e860dc, upload has finished false
2025.03.05 22:44:49.538519 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 15 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:51.001909 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:54.899292 [ 9178 ] {27613cd0-597d-4b01-aa00-25eb2c53d8bc} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54732) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: ATTACH TABLE concurrent_alter_add_drop_steroids_2), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:169: DB::ThreadPoolCallbackRunnerLocal<void, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>, std::function<void ()>>::operator()(std::function<void ()>&&, Priority) @ 0x0000000018f67c7a
10. /build/src/Storages/MergeTree/MergeTreeData.cpp:1703: DB::MergeTreeData::loadDataParts(bool, std::optional<std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>>) @ 0x000000001cbc5677
11. /build/src/Storages/StorageReplicatedMergeTree.cpp:445: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::RenamingRestrictions, bool) @ 0x000000001c4afd48
12. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageReplicatedMergeTree* std::construct_at[abi:v15000]<DB::StorageReplicatedMergeTree, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::RenamingRestrictions&, bool&, DB::StorageReplicatedMergeTree*>(DB::StorageReplicatedMergeTree*, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e8e38
13. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageReplicatedMergeTree>>::construct[abi:v15000]<DB::StorageReplicatedMergeTree, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::RenamingRestrictions&, bool&, void, void>(std::allocator<DB::StorageReplicatedMergeTree>&, DB::StorageReplicatedMergeTree*, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e8b02
14. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageReplicatedMergeTree, std::allocator<DB::StorageReplicatedMergeTree>>::__shared_ptr_emplace[abi:v15000]<String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::RenamingRestrictions&, bool&>(std::allocator<DB::StorageReplicatedMergeTree>, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e8754
15. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageReplicatedMergeTree> std::allocate_shared[abi:v15000]<DB::StorageReplicatedMergeTree, std::allocator<DB::StorageReplicatedMergeTree>, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::RenamingRestrictions&, bool&, void>(std::allocator<DB::StorageReplicatedMergeTree> const&, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e851f
16. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageReplicatedMergeTree> std::make_shared[abi:v15000]<DB::StorageReplicatedMergeTree, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::RenamingRestrictions&, bool&, void>(String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e6288
17. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:726: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e3e08
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019306cfd
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x0000000019306cbd
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019306c7d
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019306c45
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
24. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
25. /build/src/Interpreters/InterpreterCreateQuery.cpp:1493: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x000000001b01d20c
26. /build/src/Interpreters/InterpreterCreateQuery.cpp:1313: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b017166
27. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe96
28. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
29. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
30. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
31. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5

2025.03.05 22:44:54.919157 [ 9178 ] {27613cd0-597d-4b01-aa00-25eb2c53d8bc} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=0, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:169: DB::ThreadPoolCallbackRunnerLocal<void, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>, std::function<void ()>>::operator()(std::function<void ()>&&, Priority) @ 0x0000000018f67c7a
10. /build/src/Storages/MergeTree/MergeTreeData.cpp:1703: DB::MergeTreeData::loadDataParts(bool, std::optional<std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>>) @ 0x000000001cbc5677
11. /build/src/Storages/StorageReplicatedMergeTree.cpp:445: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(String const&, String const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr<DB::Context>, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::RenamingRestrictions, bool) @ 0x000000001c4afd48
12. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageReplicatedMergeTree* std::construct_at[abi:v15000]<DB::StorageReplicatedMergeTree, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::RenamingRestrictions&, bool&, DB::StorageReplicatedMergeTree*>(DB::StorageReplicatedMergeTree*, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e8e38
13. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageReplicatedMergeTree>>::construct[abi:v15000]<DB::StorageReplicatedMergeTree, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::RenamingRestrictions&, bool&, void, void>(std::allocator<DB::StorageReplicatedMergeTree>&, DB::StorageReplicatedMergeTree*, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e8b02
14. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageReplicatedMergeTree, std::allocator<DB::StorageReplicatedMergeTree>>::__shared_ptr_emplace[abi:v15000]<String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::RenamingRestrictions&, bool&>(std::allocator<DB::StorageReplicatedMergeTree>, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e8754
15. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageReplicatedMergeTree> std::allocate_shared[abi:v15000]<DB::StorageReplicatedMergeTree, std::allocator<DB::StorageReplicatedMergeTree>, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::RenamingRestrictions&, bool&, void>(std::allocator<DB::StorageReplicatedMergeTree> const&, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e851f
16. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageReplicatedMergeTree> std::make_shared[abi:v15000]<DB::StorageReplicatedMergeTree, String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>, DB::RenamingRestrictions&, bool&, void>(String&, String&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr<DB::Context>&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr<DB::MergeTreeSettings, std::default_delete<DB::MergeTreeSettings>>&&, DB::RenamingRestrictions&, bool&) @ 0x000000001d0e6288
17. /build/src/Storages/MergeTree/registerStorageMergeTree.cpp:726: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000001d0e3e08
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x0000000019306cfd
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x0000000019306cbd
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x0000000019306c7d
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000019306c45
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
24. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
25. /build/src/Interpreters/InterpreterCreateQuery.cpp:1493: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr<DB::DDLGuard, std::default_delete<DB::DDLGuard>>&) @ 0x000000001b01d20c
26. /build/src/Interpreters/InterpreterCreateQuery.cpp:1313: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000001b017166
27. /build/src/Interpreters/InterpreterCreateQuery.cpp:0: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe96
28. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
29. /build/src/Interpreters/executeQuery.cpp:1374: DB::executeQuery(String const&, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000001bbab5aa
30. /build/src/Server/TCPHandler.cpp:517: DB::TCPHandler::runImpl() @ 0x000000001d46ec60
31. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5

2025.03.05 22:44:56.852959 [ 9178 ] {646109de-7520-47f4-97c8-a02fa26e7670} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54742) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:44:56.995298 [ 9178 ] {646109de-7520-47f4-97c8-a02fa26e7670} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:44:57.473899 [ 3923 ] {17f04012-f2b2-4392-acea-3fcab01fa71a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=10): (while reading column AdvEngineID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/eac/eac3ab61-d1fb-46ce-b066-05e0cc6457e8/201403_14_19_1/ in table test.hits_s3 (eac3ab61-d1fb-46ce-b066-05e0cc6457e8) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 65409): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:48076) (comment: 00170_s3_cache.sql) (in query: SELECT count() FROM test.hits_s3 WHERE AdvEngineID != 0;), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/SerializationSparse.cpp:165: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x000000001a051489
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710

2025.03.05 22:44:57.730169 [ 3923 ] {17f04012-f2b2-4392-acea-3fcab01fa71a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=10): (while reading column AdvEngineID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/eac/eac3ab61-d1fb-46ce-b066-05e0cc6457e8/201403_14_19_1/ in table test.hits_s3 (eac3ab61-d1fb-46ce-b066-05e0cc6457e8) located on disk s3_disk of type s3, from mark 68 with max_rows_to_read = 65409): While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/SerializationSparse.cpp:165: DB::SerializationSparse::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x000000001a051489
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710

2025.03.05 22:44:58.117613 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:44:59.712334 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:01.953744 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:05.197387 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {0d6617f8-564f-43ff-a6dc-a74b9f150261::202503_1_112_20}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:05.302337 [ 3780 ] {2e7d49db-0ed2-4357-847e-3cf2d5cde35e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=32, jobs=32). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41872) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:45:05.404689 [ 3780 ] {2e7d49db-0ed2-4357-847e-3cf2d5cde35e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=32, jobs=32). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:45:06.659506 [ 3780 ] {a53d461b-a6a1-4874-bff2-9cedfed67718} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41880) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:45:06.718715 [ 3780 ] {a53d461b-a6a1-4874-bff2-9cedfed67718} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=25, jobs=25). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:45:07.036560 [ 9181 ] {6c4be1c7-4e87-450a-b395-937653512eb0} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=27, jobs=27). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41882) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: SELECT COUNT() FROM system.mutations WHERE is_done = 0 and table = 'concurrent_alter_add_drop_steroids_3'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:45:07.079318 [ 9181 ] {6c4be1c7-4e87-450a-b395-937653512eb0} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=27, jobs=27). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:45:11.752163 [ 3550 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {0d6617f8-564f-43ff-a6dc-a74b9f150261::202503_1_112_20}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:43: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce46f4
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:12.615702 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:13.364874 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:43: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce46f4
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
23. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
24. /build/src/Storages/MergeTree/MergedColumnOnlyOutputStream.cpp:69: DB::MergedColumnOnlyOutputStream::fillChecksums(std::shared_ptr<DB::IMergeTreeDataPart>&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3e41a
25. /build/src/Storages/MergeTree/MergeTask.cpp:657: DB::MergeTask::VerticalMergeStage::finalizeVerticalMergeForOneColumn() const @ 0x000000001cb6e0bd
26. /build/src/Storages/MergeTree/MergeTask.cpp:877: DB::MergeTask::VerticalMergeStage::executeVerticalMergeForAllColumns() const @ 0x000000001cb7156e
27. /build/src/Storages/MergeTree/MergeTask.cpp:829: DB::MergeTask::VerticalMergeStage::execute() @ 0x000000001cb712b8
28. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
29. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:15.204533 [ 9181 ] {c6f5cbfb-588c-498c-adcd-7fb075989a3e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=974, jobs=880). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55828) (comment: 03144_parallel_alter_add_drop_column_zookeeper_on_steroids.sh) (in query: SELECT COUNT() FROM system.replication_queue WHERE table = 'concurrent_alter_add_drop_steroids_3'), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:45:15.281279 [ 9181 ] {c6f5cbfb-588c-498c-adcd-7fb075989a3e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=974, jobs=880). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:45:17.959498 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/bnl/spbhjigxdogcfivwwnfkipqocsbkt, total size 419430400, count 419430400, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 99cd1d63-398a-4ee3-a95d-14d7ad28e956, upload has finished false.
2025.03.05 22:45:17.962201 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/bnl/spbhjigxdogcfivwwnfkipqocsbkt, total size 419430400, count 419430400, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 99cd1d63-398a-4ee3-a95d-14d7ad28e956, upload has finished false
2025.03.05 22:45:18.138072 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:18.178861 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/bnl/spbhjigxdogcfivwwnfkipqocsbkt, total size 419430400, count 419430400, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 99cd1d63-398a-4ee3-a95d-14d7ad28e956, upload has finished false
2025.03.05 22:45:18.260596 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=1): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 86 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:18.304721 [ 3615 ] {} <Error> void DB::SystemLog<DB::OpenTelemetrySpanLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::OpenTelemetrySpanLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:18.492197 [ 3583 ] {} <Warning> test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92): Removing temporary directory /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/tmp_merge_201403_1_6_1/
2025.03.05 22:45:18.492760 [ 3583 ] {} <Warning> test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/tmp_merge_201403_1_6_1/
2025.03.05 22:45:19.489383 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_6_6_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6868): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:19.627470 [ 9181 ] {6e58e80c-99da-4409-a377-72103554d225} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=14). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55862) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:45:19.673242 [ 9181 ] {6e58e80c-99da-4409-a377-72103554d225} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=14). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:45:19.677265 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7a26c9c9-7195-4e8c-807c-8ccd93ff5af2::202503_1_115_22}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:21.143050 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:24.772466 [ 3780 ] {7a32280b-a634-44bf-ad2b-949a18b3c2f0} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59774) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:45:24.825370 [ 3780 ] {7a32280b-a634-44bf-ad2b-949a18b3c2f0} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=23, jobs=23). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:45:25.985757 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/cjj/nhetdhvbomvxfcjcwkdhhzvqknzmb, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 15d6462f-6aa9-4c42-94a9-0d386f62939b, upload has finished false.
2025.03.05 22:45:25.994233 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/cjj/nhetdhvbomvxfcjcwkdhhzvqknzmb, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 15d6462f-6aa9-4c42-94a9-0d386f62939b, upload has finished false
2025.03.05 22:45:26.049023 [ 3780 ] {badfd541-c6c9-4b4d-b415-27da46753592} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59778) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:45:26.049982 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/cjj/nhetdhvbomvxfcjcwkdhhzvqknzmb, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 15d6462f-6aa9-4c42-94a9-0d386f62939b, upload has finished false
2025.03.05 22:45:26.115525 [ 3780 ] {badfd541-c6c9-4b4d-b415-27da46753592} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=3, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:45:26.221514 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 18 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:26.625521 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_1_1_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 19 with max_rows_to_read = 6658): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:28.078079 [ 3633 ] {} <Error> void DB::SystemLog<DB::TraceLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:29.601519 [ 9181 ] {cb2e49b8-3f0d-456a-9383-1b48314b2911} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59804) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:45:29.626549 [ 9181 ] {cb2e49b8-3f0d-456a-9383-1b48314b2911} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=11, jobs=11). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:45:30.672574 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 9 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:31.142360 [ 3780 ] {13d162bc-2102-4db8-9f97-021fe63ef7f0} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=35, jobs=35). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59816) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:45:31.191121 [ 3780 ] {13d162bc-2102-4db8-9f97-021fe63ef7f0} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=35, jobs=35). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:45:33.308506 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fe5b5b83-eea3-482d-90c9-5c8d7754068a::202503_1_108_24}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:34.781315 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:41.243696 [ 3780 ] {43e90a74-cfda-4202-b303-295ebcbe03e2} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=974, jobs=880). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50464) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:45:41.272439 [ 3780 ] {43e90a74-cfda-4202-b303-295ebcbe03e2} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=974, jobs=880). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:45:43.584516 [ 3614 ] {} <Error> void DB::SystemLog<DB::SessionLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38ea0
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:47.238850 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {eca2e068-f817-4cd0-b4bb-4c92546607ab::202503_1_116_23}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:49.574627 [ 3610 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:50.604490 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/vur/fgtcxunpzyexcjixeirbqxpzlvubn, total size 301989888, count 301989888, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id dbd4ecd7-a649-4014-9e4d-1f1d9d67f473, upload has finished false.
2025.03.05 22:45:50.610517 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/vur/fgtcxunpzyexcjixeirbqxpzlvubn, total size 301989888, count 301989888, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id dbd4ecd7-a649-4014-9e4d-1f1d9d67f473, upload has finished false
2025.03.05 22:45:50.722590 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/vur/fgtcxunpzyexcjixeirbqxpzlvubn, total size 301989888, count 301989888, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id dbd4ecd7-a649-4014-9e4d-1f1d9d67f473, upload has finished false
2025.03.05 22:45:50.757300 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 65 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:51.587225 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:53.262449 [ 3780 ] {c23f72cf-5d31-4564-8f97-863b68a8e7ea} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=14). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:58416) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:45:53.289555 [ 3780 ] {c23f72cf-5d31-4564-8f97-863b68a8e7ea} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=14). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:45:53.862025 [ 3541 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 4 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:54.467823 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:45:55.695877 [ 3780 ] {edffbabd-2e6c-4d9f-965b-65d87d97a53d} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=27, jobs=27). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:58424) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:45:55.746994 [ 3780 ] {edffbabd-2e6c-4d9f-965b-65d87d97a53d} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=27, jobs=27). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:45:58.391925 [ 3614 ] {} <Error> void DB::SystemLog<DB::SessionLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:06.834296 [ 3780 ] {090c398f-2750-4f08-8fa6-d167b4477a5d} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34454) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:46:06.863795 [ 3780 ] {090c398f-2750-4f08-8fa6-d167b4477a5d} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:46:08.557652 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:09.527570 [ 3582 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Removing temporary directory /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:46:09.531299 [ 3582 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:46:09.740643 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/ysh/yseofjxnbnpevokipjybiwsvwbvfk, total size 268435456, count 268435456, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e1d4b784-d39f-4367-b456-784e6706a4cc, upload has finished false.
2025.03.05 22:46:09.741504 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/ysh/yseofjxnbnpevokipjybiwsvwbvfk, total size 268435456, count 268435456, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e1d4b784-d39f-4367-b456-784e6706a4cc, upload has finished false
2025.03.05 22:46:09.839628 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/ysh/yseofjxnbnpevokipjybiwsvwbvfk, total size 268435456, count 268435456, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e1d4b784-d39f-4367-b456-784e6706a4cc, upload has finished false
2025.03.05 22:46:09.859681 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 56 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:11.346359 [ 3780 ] {2f4c900a-44f2-489b-9466-4ab3eaa626ce} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=14, jobs=14). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34468) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:46:11.371936 [ 3780 ] {2f4c900a-44f2-489b-9466-4ab3eaa626ce} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=14, jobs=14). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:46:13.938683 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:20.480312 [ 3780 ] {0c75124a-a861-459f-afb3-7305dcf39e6f} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=18, jobs=11). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60082) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:46:20.546201 [ 3780 ] {0c75124a-a861-459f-afb3-7305dcf39e6f} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=18, jobs=11). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:46:25.052216 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {09669507-4528-4e20-b87c-26ebd7ba8c50::202503_1_135_27}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:25.106900 [ 3780 ] {9596d505-5fdf-4ada-a4c4-e37dd61d35f7} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:57156) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:46:25.132462 [ 3780 ] {9596d505-5fdf-4ada-a4c4-e37dd61d35f7} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:46:25.445488 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {09669507-4528-4e20-b87c-26ebd7ba8c50::202503_1_135_27}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:28.462475 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/frv/penamgaiiiftcnojbgievpmopbrmd, total size 335544320, count 335544320, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 16a7239f-b758-4ece-babd-6eac0ddd1062, upload has finished false.
2025.03.05 22:46:28.464676 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/frv/penamgaiiiftcnojbgievpmopbrmd, total size 335544320, count 335544320, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 16a7239f-b758-4ece-babd-6eac0ddd1062, upload has finished false
2025.03.05 22:46:28.581792 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/frv/penamgaiiiftcnojbgievpmopbrmd, total size 335544320, count 335544320, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 16a7239f-b758-4ece-babd-6eac0ddd1062, upload has finished false
2025.03.05 22:46:28.608151 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 69 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:29.393468 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:31.269495 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 3 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:32.380205 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:34.263088 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:36.385518 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:274: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf391c4
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:37.862883 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 9 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:38.341611 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:38.635575 [ 3780 ] {b612b983-ae16-4e26-987b-fba6ee473fc7} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=22, jobs=22). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47490) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:46:38.651630 [ 3780 ] {b612b983-ae16-4e26-987b-fba6ee473fc7} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=22, jobs=22). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:46:38.892125 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:39.494238 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:39.750179 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:42.630055 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 7 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:43.218770 [ 3780 ] {a246b243-e42f-4bc2-9f1b-1c631f09f91c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60668) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:46:43.248071 [ 3780 ] {a246b243-e42f-4bc2-9f1b-1c631f09f91c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:46:46.728969 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {eca2e068-f817-4cd0-b4bb-4c92546607ab::202503_1_119_24}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:47.820606 [ 3780 ] {ff3a0aec-287c-43bd-a183-1e1e73e68fad} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:60682) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:46:47.863343 [ 3780 ] {ff3a0aec-287c-43bd-a183-1e1e73e68fad} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:46:50.195248 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/rkx/zkamjtpnvweevpddwqlxkrealzatm, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 600817ee-5c57-465d-b036-8172c6a104c9, upload has finished false.
2025.03.05 22:46:50.198686 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/rkx/zkamjtpnvweevpddwqlxkrealzatm, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 600817ee-5c57-465d-b036-8172c6a104c9, upload has finished false
2025.03.05 22:46:50.249585 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/rkx/zkamjtpnvweevpddwqlxkrealzatm, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 600817ee-5c57-465d-b036-8172c6a104c9, upload has finished false
2025.03.05 22:46:50.308176 [ 3541 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 22 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:50.357010 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fe5b5b83-eea3-482d-90c9-5c8d7754068a::202503_1_117_29}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:52.988017 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fe5b5b83-eea3-482d-90c9-5c8d7754068a::202503_1_117_29}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:53.075396 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {9f912096-7afb-496b-86c7-16abf59bb4e4::202503_1_131_26}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:53.705662 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {9f912096-7afb-496b-86c7-16abf59bb4e4::202503_1_131_26}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:57.204839 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:46:57.288324 [ 3780 ] {adbe9cb7-6676-471f-aa4b-9c820c45bedd} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47768) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:46:57.383710 [ 3780 ] {adbe9cb7-6676-471f-aa4b-9c820c45bedd} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=31, jobs=31). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:47:01.176343 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/xgd/uhvzgvbqrwbiuelrcptclsqwjnxpd, total size 150994944, count 150994944, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id f9f3fd27-3bb6-4691-b437-ae07ae42f956, upload has finished false.
2025.03.05 22:47:01.181656 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/xgd/uhvzgvbqrwbiuelrcptclsqwjnxpd, total size 150994944, count 150994944, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id f9f3fd27-3bb6-4691-b437-ae07ae42f956, upload has finished false
2025.03.05 22:47:01.237015 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/xgd/uhvzgvbqrwbiuelrcptclsqwjnxpd, total size 150994944, count 150994944, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id f9f3fd27-3bb6-4691-b437-ae07ae42f956, upload has finished false
2025.03.05 22:47:01.271004 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:567: DB::WriteBufferFromS3::writePart(DB::WriteBufferFromS3::PartData&&) @ 0x000000001991336e
18. /build/src/IO/WriteBufferFromS3.cpp:370: DB::WriteBufferFromS3::writeMultipartUpload() @ 0x00000000199074b6
19. /build/src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::nextImpl() @ 0x0000000019906b7e
20. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
21. /build/src/IO/WriteBufferFromFileDecorator.cpp:71: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x000000001a3579ad
22. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
23. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
24. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
25. /build/src/IO/WriteBuffer.h:76: DB::WriteBuffer::nextIfAtEnd() @ 0x000000000a92ff78
26. /build/src/IO/WriteBuffer.h:91: DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000a92fde0
27. /build/src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x0000000019ddbded
28. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
29. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
30. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
31. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:350: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ccf3e39
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:01.336036 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {9f912096-7afb-496b-86c7-16abf59bb4e4::202503_1_131_26}: Code: 241. DB::Exception: Memory tracker (for thread): fault injected (at specific point). (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<char const*, char const*>(int, FormatStringHelperImpl<std::type_identity<char const*>::type, std::type_identity<char const*>::type>, char const*&&, char const*&&) @ 0x00000000132e996c
6. /build/src/Common/MemoryTracker.cpp:184: MemoryTracker::injectFault() const @ 0x00000000132e6d5f
7. /build/src/Common/CurrentMemoryTracker.cpp:129: CurrentMemoryTracker::injectFault() @ 0x0000000013255905
8. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:149: DB::MergePlainMergeTreeTask::finish() @ 0x000000001d13e718
9. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:71: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13de76
10. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
11. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
12. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001cba8a15
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001cba89dd
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:01.982176 [ 3780 ] {7e461a35-24c3-48e8-aad3-b0700f8aa4b2} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:47778) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:47:02.010952 [ 3780 ] {7e461a35-24c3-48e8-aad3-b0700f8aa4b2} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=6, jobs=6). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:47:02.437721 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:05.218077 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 7 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:06.492478 [ 3780 ] {7d4cc326-67c9-4a26-9576-06a22c4b03f4} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:32908) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:47:06.552238 [ 3780 ] {7d4cc326-67c9-4a26-9576-06a22c4b03f4} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:47:10.747771 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/lxp/abvxxwnlmdrdhcsctpsxarchlpxol, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 5985edc4-7e87-42b1-bfcc-ba7bcb4f5449, upload has finished false.
2025.03.05 22:47:10.749045 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/lxp/abvxxwnlmdrdhcsctpsxarchlpxol, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 5985edc4-7e87-42b1-bfcc-ba7bcb4f5449, upload has finished false
2025.03.05 22:47:10.786117 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/lxp/abvxxwnlmdrdhcsctpsxarchlpxol, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 5985edc4-7e87-42b1-bfcc-ba7bcb4f5449, upload has finished false
2025.03.05 22:47:10.860676 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 15 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:11.160624 [ 3780 ] {77cb5b3c-60d0-4e34-b1c8-bb032f872db1} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=37, jobs=37). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:32912) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:47:11.189677 [ 3780 ] {77cb5b3c-60d0-4e34-b1c8-bb032f872db1} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=37, jobs=37). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:47:14.251763 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {6cd90e1d-0955-4f5f-a660-a94482f8afc2::202503_1_101_20}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:15.385386 [ 3545 ] {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key s3/xkc/zymmmqyslnbfrwboxuksingimpwuy, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 6e57999c-371e-49b8-bb1b-a0270bf43809, upload has finished false.
2025.03.05 22:47:15.390489 [ 3545 ] {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key s3/xkc/zymmmqyslnbfrwboxuksingimpwuy, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 6e57999c-371e-49b8-bb1b-a0270bf43809, upload has finished false
2025.03.05 22:47:15.458903 [ 3545 ] {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key s3/xkc/zymmmqyslnbfrwboxuksingimpwuy, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 6e57999c-371e-49b8-bb1b-a0270bf43809, upload has finished false
2025.03.05 22:47:15.668491 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=1): (while reading column Referer): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_5_5_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 11 with max_rows_to_read = 6739): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:15.913643 [ 3780 ] {50815511-2fd6-4e8c-8b6d-a3b5b2b5b8b6} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41376) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:47:15.964925 [ 3780 ] {50815511-2fd6-4e8c-8b6d-a3b5b2b5b8b6} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:47:20.584088 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_6_6_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6868): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:22.268840 [ 3552 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/pfa/svphmxycykbxulunjrxrkrzgcwpxm, total size 150994944, count 150994944, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2d77b09d-ae71-45de-8acc-263f566eeae0, upload has finished false.
2025.03.05 22:47:22.270101 [ 3552 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/pfa/svphmxycykbxulunjrxrkrzgcwpxm, total size 150994944, count 150994944, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2d77b09d-ae71-45de-8acc-263f566eeae0, upload has finished false
2025.03.05 22:47:22.377175 [ 3552 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/pfa/svphmxycykbxulunjrxrkrzgcwpxm, total size 150994944, count 150994944, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2d77b09d-ae71-45de-8acc-263f566eeae0, upload has finished false
2025.03.05 22:47:22.450709 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 35 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:23.713115 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=1): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:25.146103 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {1c723b97-5f9d-496d-81d4-e674245041aa::202503_1_110_22}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:26.668445 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fe5b5b83-eea3-482d-90c9-5c8d7754068a::202503_1_121_33}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:28.513724 [ 3552 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/hhg/acbsnaqesqtiahfhmzwxuxxmozqxt, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 81438983-a3b9-4e42-9a00-6a09987b1e2f, upload has finished false.
2025.03.05 22:47:28.514512 [ 3552 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/hhg/acbsnaqesqtiahfhmzwxuxxmozqxt, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 81438983-a3b9-4e42-9a00-6a09987b1e2f, upload has finished false
2025.03.05 22:47:28.551590 [ 3552 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/hhg/acbsnaqesqtiahfhmzwxuxxmozqxt, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 81438983-a3b9-4e42-9a00-6a09987b1e2f, upload has finished false
2025.03.05 22:47:28.645029 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 12 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:29.550358 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {1debc995-8692-4c42-954c-57d52f901198::202503_1_34_7}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:31.070243 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38ea0
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:35.205780 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/czr/iumytohubcdlfhbkrqfufilyuycph, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 0adebb1e-02f8-410f-b19f-6d8c251a29a9, upload has finished false.
2025.03.05 22:47:35.210100 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/czr/iumytohubcdlfhbkrqfufilyuycph, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 0adebb1e-02f8-410f-b19f-6d8c251a29a9, upload has finished false
2025.03.05 22:47:35.259481 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/czr/iumytohubcdlfhbkrqfufilyuycph, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 0adebb1e-02f8-410f-b19f-6d8c251a29a9, upload has finished false
2025.03.05 22:47:35.348529 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 21 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:36.017045 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:37.902649 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 4 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:38.857010 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:38.863160 [ 3614 ] {} <Error> void DB::SystemLog<DB::SessionLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::SessionLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:39.664999 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:45.819685 [ 3653 ] {} <Error> void DB::SystemLog<DB::BlobStorageLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::BlobStorageLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:46.273755 [ 3550 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/lig/gtxwqtihkoblespjifvnvxkdlfash, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id cf4c0541-daf7-4122-897f-4f10c497395d, upload has finished false.
2025.03.05 22:47:46.275891 [ 3550 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/lig/gtxwqtihkoblespjifvnvxkdlfash, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id cf4c0541-daf7-4122-897f-4f10c497395d, upload has finished false
2025.03.05 22:47:46.317838 [ 3550 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/lig/gtxwqtihkoblespjifvnvxkdlfash, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id cf4c0541-daf7-4122-897f-4f10c497395d, upload has finished false
2025.03.05 22:47:46.344762 [ 3550 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=1): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 16 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:49.017511 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 6 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:50.923324 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 3 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:55.925831 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/wtx/rfkdigmeufgolgklakdyvhyjfamcq, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id a1c94ca0-e94d-4678-833c-2bc1cbdb8ddb, upload has finished false.
2025.03.05 22:47:55.927554 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/wtx/rfkdigmeufgolgklakdyvhyjfamcq, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id a1c94ca0-e94d-4678-833c-2bc1cbdb8ddb, upload has finished false
2025.03.05 22:47:55.957429 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/wtx/rfkdigmeufgolgklakdyvhyjfamcq, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id a1c94ca0-e94d-4678-833c-2bc1cbdb8ddb, upload has finished false
2025.03.05 22:47:56.000555 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=1): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 14 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:56.890581 [ 3780 ] {fffe19d4-e970-4155-9ff3-329a46a5f2d7} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=15, jobs=15). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46158) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:47:56.915878 [ 3780 ] {fffe19d4-e970-4155-9ff3-329a46a5f2d7} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=15, jobs=15). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:47:58.281647 [ 3550 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {388a668d-c3ee-4b85-bfa8-acb99b8c5d8d::202503_1_95_19}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:58.389307 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 6 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:47:58.792037 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:00.765245 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:01.486106 [ 3780 ] {f10064cc-a758-4539-bc66-e89f5522fec2} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=29, jobs=29). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46170) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:48:01.524997 [ 3780 ] {f10064cc-a758-4539-bc66-e89f5522fec2} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=29, jobs=29). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:48:03.787055 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column Hits): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_5_5_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6739): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:05.837297 [ 3780 ] {817463b5-9aa4-42e9-b4ec-c76642a7096a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=974, jobs=880). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39980) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:48:05.852070 [ 3780 ] {817463b5-9aa4-42e9-b4ec-c76642a7096a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=974, jobs=880). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:48:08.342612 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38ea0
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:09.689770 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:10.309763 [ 3780 ] {462e5dad-d4d8-44fc-ad42-6db734264c81} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:39996) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:48:10.346987 [ 3780 ] {462e5dad-d4d8-44fc-ad42-6db734264c81} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=5, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:48:11.374357 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/dve/gjhtxrocuyplratfureandifgijsl, total size 150994944, count 150994944, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id cef55bbd-e919-4525-8e65-9f831a13ab13, upload has finished false.
2025.03.05 22:48:11.375377 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/dve/gjhtxrocuyplratfureandifgijsl, total size 150994944, count 150994944, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id cef55bbd-e919-4525-8e65-9f831a13ab13, upload has finished false
2025.03.05 22:48:11.443729 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/dve/gjhtxrocuyplratfureandifgijsl, total size 150994944, count 150994944, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id cef55bbd-e919-4525-8e65-9f831a13ab13, upload has finished false
2025.03.05 22:48:11.487097 [ 3541 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 35 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:13.657135 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:17.998929 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:20.673931 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/vby/dkewvmrdshqdszegmlltobazzdqqd, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id cbfcb6a9-f0b6-4c71-97a1-c2aafaef2a41, upload has finished false.
2025.03.05 22:48:20.674694 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/vby/dkewvmrdshqdszegmlltobazzdqqd, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id cbfcb6a9-f0b6-4c71-97a1-c2aafaef2a41, upload has finished false
2025.03.05 22:48:20.733036 [ 3547 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/vby/dkewvmrdshqdszegmlltobazzdqqd, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id cbfcb6a9-f0b6-4c71-97a1-c2aafaef2a41, upload has finished false
2025.03.05 22:48:20.829919 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 28 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:21.850873 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:23.484440 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:24.805148 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 10 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:25.985923 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {0d6617f8-564f-43ff-a6dc-a74b9f150261::202503_113_137_5}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:26.852655 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 3 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:29.470217 [ 3550 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:43: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce46f4
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
23. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
24. /build/src/Storages/MergeTree/MergedColumnOnlyOutputStream.cpp:69: DB::MergedColumnOnlyOutputStream::fillChecksums(std::shared_ptr<DB::IMergeTreeDataPart>&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf3e41a
25. /build/src/Storages/MergeTree/MergeTask.cpp:657: DB::MergeTask::VerticalMergeStage::finalizeVerticalMergeForOneColumn() const @ 0x000000001cb6e0bd
26. /build/src/Storages/MergeTree/MergeTask.cpp:877: DB::MergeTask::VerticalMergeStage::executeVerticalMergeForAllColumns() const @ 0x000000001cb7156e
27. /build/src/Storages/MergeTree/MergeTask.cpp:829: DB::MergeTask::VerticalMergeStage::execute() @ 0x000000001cb712b8
28. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
29. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:32.437680 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=1): (while reading column Sign): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_2_2_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6592): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:32.881556 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/cjk/hcijvatqeetifhsrwheiclzxgmjil, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4356401c-9593-4623-8d91-b7eae19978ba, upload has finished false.
2025.03.05 22:48:32.882547 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/cjk/hcijvatqeetifhsrwheiclzxgmjil, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4356401c-9593-4623-8d91-b7eae19978ba, upload has finished false
2025.03.05 22:48:32.923958 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/cjk/hcijvatqeetifhsrwheiclzxgmjil, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 4356401c-9593-4623-8d91-b7eae19978ba, upload has finished false
2025.03.05 22:48:32.963866 [ 3541 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 17 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:33.502442 [ 3780 ] {4c99c460-e3ec-457e-aac2-e1691a326f04} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=7). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54308) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:48:33.515308 [ 3780 ] {4c99c460-e3ec-457e-aac2-e1691a326f04} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=14, jobs=7). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:48:34.500403 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_138_207_13}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:35.420709 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=1): (while reading column StartDate): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_4_4_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6741): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:36.779135 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 10 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:37.178537 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:37.203136 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:37.391486 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_138_207_13}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:37.797468 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:38.221925 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_138_207_13}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:38.234800 [ 3780 ] {97e83b96-e6c7-4fec-86a7-228dbdf38b91} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54324) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:48:38.254186 [ 3780 ] {97e83b96-e6c7-4fec-86a7-228dbdf38b91} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=17, jobs=17). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:48:39.632466 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:42.675412 [ 3780 ] {624b0453-402f-4728-bf1e-13540b3b813a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54338) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:48:42.719011 [ 3780 ] {624b0453-402f-4728-bf1e-13540b3b813a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:48:43.269390 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:45.552475 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/url/nbkybjbbszhjxmimcqlfojazdcrgm, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id f6ddb19d-23f8-476e-aa6f-13483833cb45, upload has finished false.
2025.03.05 22:48:45.556614 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/url/nbkybjbbszhjxmimcqlfojazdcrgm, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id f6ddb19d-23f8-476e-aa6f-13483833cb45, upload has finished false
2025.03.05 22:48:45.588008 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/url/nbkybjbbszhjxmimcqlfojazdcrgm, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id f6ddb19d-23f8-476e-aa6f-13483833cb45, upload has finished false
2025.03.05 22:48:45.658524 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 16 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:46.515103 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:47.097756 [ 3780 ] {1126126e-d89f-41b0-bdde-fadd16d4c733} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46212) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:48:47.124103 [ 3780 ] {1126126e-d89f-41b0-bdde-fadd16d4c733} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:48:47.812185 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 4 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:49.492837 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_3_3_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 19 with max_rows_to_read = 6608): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:51.193155 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:51.433098 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:52.524936 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:55.922492 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=1): (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_5_5_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 1 with max_rows_to_read = 6739): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:48:58.921197 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/xlj/xsqssaqvqppmgrtvnpqfxukwzccxo, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e85bdbc2-b325-42bb-9bcf-610141ed7891, upload has finished false.
2025.03.05 22:48:58.922802 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/xlj/xsqssaqvqppmgrtvnpqfxukwzccxo, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e85bdbc2-b325-42bb-9bcf-610141ed7891, upload has finished false
2025.03.05 22:48:59.005637 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/xlj/xsqssaqvqppmgrtvnpqfxukwzccxo, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e85bdbc2-b325-42bb-9bcf-610141ed7891, upload has finished false
2025.03.05 22:48:59.089159 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=1): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 37 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:00.952129 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {388a668d-c3ee-4b85-bfa8-acb99b8c5d8d::202503_1_103_21}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:04.547729 [ 3780 ] {4394799f-a0a5-4fe1-913a-62c334188965} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=974, jobs=880). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55848) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:49:04.573754 [ 3780 ] {4394799f-a0a5-4fe1-913a-62c334188965} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=974, jobs=880). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:49:05.825363 [ 3550 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/avf/giahkekqeynymwiwsgcngfrtubish, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 17048733-0712-4eda-ad4c-a87d0946fff3, upload has finished false.
2025.03.05 22:49:05.829377 [ 3550 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/avf/giahkekqeynymwiwsgcngfrtubish, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 17048733-0712-4eda-ad4c-a87d0946fff3, upload has finished false
2025.03.05 22:49:05.868068 [ 3550 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/avf/giahkekqeynymwiwsgcngfrtubish, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 17048733-0712-4eda-ad4c-a87d0946fff3, upload has finished false
2025.03.05 22:49:05.920492 [ 3550 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 19 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:07.202901 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:09.318071 [ 3780 ] {a5380a3a-2c5f-4ae2-9cd5-84f9ec55ddf1} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55858) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:49:09.338268 [ 3780 ] {a5380a3a-2c5f-4ae2-9cd5-84f9ec55ddf1} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:49:09.694244 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 6 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:11.274283 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {0d6617f8-564f-43ff-a6dc-a74b9f150261::202503_113_142_6}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:11.718268 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:13.086782 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 9 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:13.557725 [ 3780 ] {5acbda80-f80a-4087-bbe7-153079fa3047} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:52340) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:49:13.586908 [ 3780 ] {5acbda80-f80a-4087-bbe7-153079fa3047} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:49:15.199108 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:16.811507 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:19.732736 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/jce/gowbkgzjqysvkwxiofqxgjhhyubai, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id c67bb5df-93a8-4dd2-bac6-f406477c8c0c, upload has finished false.
2025.03.05 22:49:19.737726 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/jce/gowbkgzjqysvkwxiofqxgjhhyubai, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id c67bb5df-93a8-4dd2-bac6-f406477c8c0c, upload has finished false
2025.03.05 22:49:19.809452 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/jce/gowbkgzjqysvkwxiofqxgjhhyubai, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id c67bb5df-93a8-4dd2-bac6-f406477c8c0c, upload has finished false
2025.03.05 22:49:19.871105 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 20 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:21.994407 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {1debc995-8692-4c42-954c-57d52f901198::202503_35_39_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:22.319849 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column IsNew): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_2_2_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6592): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:22.625000 [ 3780 ] {b84c6631-f0e0-4828-a038-2294ec5af81e} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:52358) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:49:22.749933 [ 3780 ] {b84c6631-f0e0-4828-a038-2294ec5af81e} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=4, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:49:24.485214 [ 3610 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:26.027926 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/cte/ozlepbcybhfxqagbxcmcqdbkksuzm, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id efb98caf-fe60-443c-a7b2-4796b60054a6, upload has finished false.
2025.03.05 22:49:26.038187 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/cte/ozlepbcybhfxqagbxcmcqdbkksuzm, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id efb98caf-fe60-443c-a7b2-4796b60054a6, upload has finished false
2025.03.05 22:49:26.088532 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/cte/ozlepbcybhfxqagbxcmcqdbkksuzm, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id efb98caf-fe60-443c-a7b2-4796b60054a6, upload has finished false
2025.03.05 22:49:26.156672 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 20 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:26.536468 [ 3541 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fe5b5b83-eea3-482d-90c9-5c8d7754068a::202503_1_130_42}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:28.892625 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fe5b5b83-eea3-482d-90c9-5c8d7754068a::202503_1_130_42}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:310: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39986
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
23. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
24. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
25. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
26. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
27. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001cba8a35
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:32.460001 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/swv/iyyztqsnbxvovjvhmjuaepdumgdip, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id bc29823c-f1b2-4a90-b4c5-d7b1633c2721, upload has finished false.
2025.03.05 22:49:32.461377 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/swv/iyyztqsnbxvovjvhmjuaepdumgdip, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id bc29823c-f1b2-4a90-b4c5-d7b1633c2721, upload has finished false
2025.03.05 22:49:32.494032 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/swv/iyyztqsnbxvovjvhmjuaepdumgdip, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id bc29823c-f1b2-4a90-b4c5-d7b1633c2721, upload has finished false
2025.03.05 22:49:32.540465 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 15 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:33.530707 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:34.312521 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {9f912096-7afb-496b-86c7-16abf59bb4e4::202503_1_146_29}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:35.176171 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 2 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:36.050687 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {1debc995-8692-4c42-954c-57d52f901198::202503_1_41_7}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce5582c
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55735
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55663
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce55515
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&&, unsigned long&&) @ 0x000000001ce52abb
24. /build/src/Storages/MergeTree/MergeTreeReaderCompact.cpp:37: DB::MergeTreeReaderCompact::MergeTreeReaderCompact(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::NamesAndTypesList, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*, DB::MarkCache*, DB::MarkRanges, DB::MergeTreeReaderSettings, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>>, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int) @ 0x000000001ce50d0a
25. /build/src/Storages/MergeTree/MergeTreeReaderCompactSingleBuffer.h:16: DB::MergeTreeReaderCompactSingleBuffer::MergeTreeReaderCompactSingleBuffer<std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc15a5
26. /build/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714: std::__unique_if<DB::MergeTreeReaderCompactSingleBuffer>::__unique_single std::make_unique[abi:v15000]<DB::MergeTreeReaderCompactSingleBuffer, std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int>(std::shared_ptr<DB::LoadedMergeTreeDataPartInfoForReader>&, DB::NamesAndTypesList const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::UncompressedCache*&, DB::MarkCache*&, DB::MarkRanges const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int&&) @ 0x000000001ccc097d
27. /build/src/Storages/MergeTree/MergeTreeDataPartCompact.cpp:43: DB::MergeTreeDataPartCompact::getReader(DB::NamesAndTypesList const&, std::shared_ptr<DB::StorageSnapshot> const&, DB::MarkRanges const&, std::unordered_map<String, DB::Field, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, DB::Field>>> const&, DB::UncompressedCache*, DB::MarkCache*, std::shared_ptr<DB::AlterConversions const> const&, DB::MergeTreeReaderSettings const&, std::map<String, double, std::less<String>, std::allocator<std::pair<String const, double>>> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&) const @ 0x000000001ccbdcf3
28. /build/src/Storages/MergeTree/MergeTreeSequentialSource.cpp:177: DB::MergeTreeSequentialSource::MergeTreeSequentialSource(DB::MergeTreeSequentialSourceType, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>, std::vector<String, std::allocator<String>>, std::optional<DB::MarkRanges>, bool, bool, bool, bool) @ 0x000000001ce70cf0
29. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeSequentialSource* std::construct_at[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, DB::MergeTreeSequentialSource*>(DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74e47
30. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeSequentialSource>>::construct[abi:v15000]<DB::MergeTreeSequentialSource, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&, void, void>(std::allocator<DB::MergeTreeSequentialSource>&, DB::MergeTreeSequentialSource*, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce74b04
31. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeSequentialSource, std::allocator<DB::MergeTreeSequentialSource>>::__shared_ptr_emplace[abi:v15000]<DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>, bool, bool&, bool&, bool&>(std::allocator<DB::MergeTreeSequentialSource>, DB::MergeTreeSequentialSourceType&, DB::MergeTreeData const&, std::shared_ptr<DB::StorageSnapshot> const&, std::shared_ptr<DB::IMergeTreeDataPart const>&, std::vector<String, std::allocator<String>>&, std::optional<DB::MarkRanges>&&, bool&&, bool&, bool&, bool&) @ 0x000000001ce747b1
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:36.522925 [ 3780 ] {66e6870e-0e32-448d-8453-eaf5216bd4d8} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=33, jobs=33). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50972) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:49:36.578107 [ 3780 ] {66e6870e-0e32-448d-8453-eaf5216bd4d8} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=33, jobs=33). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:49:36.687416 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column n): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:38.645010 [ 3547 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 4 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:40.149627 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:41.370963 [ 3780 ] {6fc99130-8b82-4569-8b2d-24f4e93d8f06} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=15, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50978) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:49:41.501226 [ 3780 ] {6fc99130-8b82-4569-8b2d-24f4e93d8f06} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=15, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:49:43.054348 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 6 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:52.635540 [ 3587 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Removing temporary directory /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:49:52.636557 [ 3587 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:49:52.797593 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/ubd/ldpsvvhjiusjbakuemimyoqmzpqqs, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id f6133553-f23c-4878-b874-8ec0eb55f08f, upload has finished false.
2025.03.05 22:49:52.798410 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/ubd/ldpsvvhjiusjbakuemimyoqmzpqqs, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id f6133553-f23c-4878-b874-8ec0eb55f08f, upload has finished false
2025.03.05 22:49:52.901707 [ 3553 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/ubd/ldpsvvhjiusjbakuemimyoqmzpqqs, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id f6133553-f23c-4878-b874-8ec0eb55f08f, upload has finished false
2025.03.05 22:49:52.990414 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 36 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:55.511777 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:55.933237 [ 3541 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:55.985011 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column UTCStartTime): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_3_3_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6608): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:58.720809 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=1): (while reading column Sign): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_1_1_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6658): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:49:59.525382 [ 3780 ] {4895fac1-c4ea-48f9-b58a-13ba4611f8d1} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=974, jobs=880). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:59884) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:49:59.541256 [ 3780 ] {4895fac1-c4ea-48f9-b58a-13ba4611f8d1} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=974, jobs=880). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133db2ad
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d3258
8. /build/src/Common/ThreadPool.cpp:338: ThreadPoolImpl<std::thread>::scheduleOrThrow(std::function<void ()>, Priority, unsigned long, bool) @ 0x00000000133d3b10
9. /build/src/Common/ThreadPool.h:205: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) @ 0x000000001d537af3
10. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:112: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long) @ 0x000000001d537834
11. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:138: DB::PullingAsyncPipelineExecutor::pull(DB::Block&, unsigned long) @ 0x000000001d537be9
12. /build/src/Server/TCPHandler.cpp:1023: DB::TCPHandler::processOrdinaryQuery() @ 0x000000001d479b7f
13. /build/src/Server/TCPHandler.cpp:539: DB::TCPHandler::runImpl() @ 0x000000001d46ee5b
14. /build/src/Server/TCPHandler.cpp:2339: DB::TCPHandler::run() @ 0x000000001d485ec5
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:50:03.456075 [ 3633 ] {} <Error> void DB::SystemLog<DB::TraceLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:08.768738 [ 3780 ] {2ef1cd6b-00b8-443a-bac4-09f32bdff972} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=25, jobs=5). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:35292) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:50:08.811749 [ 3780 ] {2ef1cd6b-00b8-443a-bac4-09f32bdff972} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=25, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:50:12.071334 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/ybv/wharhojsaupkttnvdtnlhgwuzkkvd, total size 268435456, count 268435456, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e5576d59-1130-40d3-8923-0352625be1e9, upload has finished false.
2025.03.05 22:50:12.072649 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/ybv/wharhojsaupkttnvdtnlhgwuzkkvd, total size 268435456, count 268435456, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e5576d59-1130-40d3-8923-0352625be1e9, upload has finished false
2025.03.05 22:50:12.174631 [ 3545 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/ybv/wharhojsaupkttnvdtnlhgwuzkkvd, total size 268435456, count 268435456, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e5576d59-1130-40d3-8923-0352625be1e9, upload has finished false
2025.03.05 22:50:12.223118 [ 3545 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 56 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:13.001402 [ 3780 ] {a2f18b91-1db3-4383-84a0-0f14cdb0e7f9} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54490) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:50:13.030445 [ 3780 ] {a2f18b91-1db3-4383-84a0-0f14cdb0e7f9} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=1, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:50:15.125160 [ 3610 ] {} <Error> void DB::SystemLog<DB::TransactionsInfoLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TransactionsInfoLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:17.572435 [ 3780 ] {6654f794-f96a-4fb4-a580-eb83baba1b88} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=21, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:54500) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:50:17.660125 [ 3780 ] {6654f794-f96a-4fb4-a580-eb83baba1b88} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=21, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:50:18.674816 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/cwl/rilewwepodgkvjmzhzzprbrbelthz, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 6f37bdfe-3e85-4066-b3e2-37be108772cf, upload has finished false.
2025.03.05 22:50:18.675875 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/cwl/rilewwepodgkvjmzhzzprbrbelthz, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 6f37bdfe-3e85-4066-b3e2-37be108772cf, upload has finished false
2025.03.05 22:50:18.710217 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/cwl/rilewwepodgkvjmzhzzprbrbelthz, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 6f37bdfe-3e85-4066-b3e2-37be108772cf, upload has finished false
2025.03.05 22:50:18.764141 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 17 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:20.186869 [ 3633 ] {} <Error> void DB::SystemLog<DB::TraceLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:23.725228 [ 3607 ] {} <Error> void DB::SystemLog<DB::ZooKeeperLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ZooKeeperLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:260: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38ea0
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:23.821019 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/hnf/lmxcobnciycmirpjhzgbjkyekrdwl, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 58692428-4dc0-48fe-84f5-0e2134962a27, upload has finished false.
2025.03.05 22:50:23.822013 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/hnf/lmxcobnciycmirpjhzgbjkyekrdwl, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 58692428-4dc0-48fe-84f5-0e2134962a27, upload has finished false
2025.03.05 22:50:23.831302 [ 3549 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/hnf/lmxcobnciycmirpjhzgbjkyekrdwl, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 58692428-4dc0-48fe-84f5-0e2134962a27, upload has finished false
2025.03.05 22:50:23.884996 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:567: DB::WriteBufferFromS3::writePart(DB::WriteBufferFromS3::PartData&&) @ 0x000000001991336e
18. /build/src/IO/WriteBufferFromS3.cpp:370: DB::WriteBufferFromS3::writeMultipartUpload() @ 0x00000000199074b6
19. /build/src/IO/WriteBufferFromS3.cpp:0: DB::WriteBufferFromS3::nextImpl() @ 0x0000000019906b7e
20. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
21. /build/src/IO/WriteBufferFromFileDecorator.cpp:71: DB::WriteBufferFromFileDecorator::nextImpl() @ 0x000000001a3579ad
22. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
23. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
24. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
25. /build/src/IO/WriteBuffer.h:76: DB::WriteBuffer::nextIfAtEnd() @ 0x000000000a92ff78
26. /build/src/IO/WriteBuffer.h:91: DB::WriteBuffer::write(char const*, unsigned long) @ 0x000000000a92fde0
27. /build/src/Compression/CompressedWriteBuffer.cpp:58: DB::CompressedWriteBuffer::nextImpl() @ 0x0000000019ddbded
28. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
29. /build/src/IO/HashingWriteBuffer.h:64: DB::HashingWriteBuffer::nextImpl() @ 0x000000001ca77e1d
30. /build/src/IO/WriteBuffer.h:53: DB::WriteBuffer::next() @ 0x000000000a929aed
31. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:350: DB::MergeTreeDataPartWriterWide::getCurrentMarksForColumn(DB::NameAndTypePair const&, std::set<String, std::less<String>, std::allocator<String>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ccf3e39
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:23.971636 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:30.881261 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {7a26c9c9-7195-4e8c-807c-8ccd93ff5af2::202503_1_134_41}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreePartition.cpp:441: DB::MergeTreePartition::store(DB::Block const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&, DB::WriteSettings const&) const @ 0x000000001ce2ecc6
21. /build/src/Storages/MergeTree/MergeTreePartition.cpp:421: DB::MergeTreePartition::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001ce2de78
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:239: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf389b5
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:32.987583 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/qzq/zjyqlpbrpoesyinpdyinmbesqzsnw, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2203b521-35bf-40d6-9939-b2311c67f52d, upload has finished false.
2025.03.05 22:50:32.989164 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/qzq/zjyqlpbrpoesyinpdyinmbesqzsnw, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2203b521-35bf-40d6-9939-b2311c67f52d, upload has finished false
2025.03.05 22:50:33.047928 [ 3551 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/qzq/zjyqlpbrpoesyinpdyinmbesqzsnw, total size 134217728, count 134217728, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 2203b521-35bf-40d6-9939-b2311c67f52d, upload has finished false
2025.03.05 22:50:33.116234 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 29 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:35.678584 [ 3780 ] {96dd1be1-cdb3-4f91-b751-313f3294221c} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=39, jobs=39). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41002) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:50:35.696630 [ 3780 ] {96dd1be1-cdb3-4f91-b751-313f3294221c} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=39, jobs=39). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:50:36.326296 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 8 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:37.175360 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column PageViews): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_1_1_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6658): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:40.076600 [ 3780 ] {95fd8043-0162-4c6d-9519-993efbab7eb9} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=16, jobs=16). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:41004) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:50:40.096487 [ 3780 ] {95fd8043-0162-4c6d-9519-993efbab7eb9} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=16, jobs=16). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:50:40.436090 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=2): (while reading column StartDate): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_1_1_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6658): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:41.170834 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/kwo/zwoledruntrpjbdjwjbbogqzkaqtt, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 3e50d53a-1971-445d-87fc-b1f4d6f945f8, upload has finished false.
2025.03.05 22:50:41.172446 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/kwo/zwoledruntrpjbdjwjbbogqzkaqtt, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 3e50d53a-1971-445d-87fc-b1f4d6f945f8, upload has finished false
2025.03.05 22:50:41.203517 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/kwo/zwoledruntrpjbdjwjbbogqzkaqtt, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 3e50d53a-1971-445d-87fc-b1f4d6f945f8, upload has finished false
2025.03.05 22:50:41.307437 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 15 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:41.703651 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:42.943899 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:44.024595 [ 3550 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=1): (while reading column Sign): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_3_3_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6608): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:44.064266 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 1 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:44.442740 [ 3780 ] {bbd357ae-9a2a-4a88-9d91-e0c87d9d18ee} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=20, jobs=20). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:40234) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:50:44.576173 [ 3780 ] {bbd357ae-9a2a-4a88-9d91-e0c87d9d18ee} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=20, jobs=20). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:50:45.006993 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:50.109421 [ 3542 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/syd/iboaishkdngruyulftxdoyxwbehwk, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 8c8414cf-740f-497b-a593-6cf5eab04306, upload has finished false.
2025.03.05 22:50:50.118550 [ 3542 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/syd/iboaishkdngruyulftxdoyxwbehwk, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 8c8414cf-740f-497b-a593-6cf5eab04306, upload has finished false
2025.03.05 22:50:50.170325 [ 3542 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/syd/iboaishkdngruyulftxdoyxwbehwk, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 8c8414cf-740f-497b-a593-6cf5eab04306, upload has finished false
2025.03.05 22:50:50.215463 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 15 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:50.636443 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:51.278786 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:52.599029 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:53.516313 [ 3780 ] {94cd8ede-d44f-443a-aecc-d9f1399444bd} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55158) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:50:53.551229 [ 3780 ] {94cd8ede-d44f-443a-aecc-d9f1399444bd} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=26, jobs=26). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:50:56.548061 [ 3542 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/cbj/xrccjcczejiqkutlvseqaefqnnxgf, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id d6f313a1-ff82-4447-8030-31d77223e2a8, upload has finished false.
2025.03.05 22:50:56.549288 [ 3542 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/cbj/xrccjcczejiqkutlvseqaefqnnxgf, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id d6f313a1-ff82-4447-8030-31d77223e2a8, upload has finished false
2025.03.05 22:50:56.589040 [ 3542 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/cbj/xrccjcczejiqkutlvseqaefqnnxgf, total size 83886080, count 83886080, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id d6f313a1-ff82-4447-8030-31d77223e2a8, upload has finished false
2025.03.05 22:50:56.643589 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_1_1_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 21 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:50:58.201914 [ 3780 ] {b866ab26-6877-4e89-85a5-573651c2024f} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=27, jobs=27). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55172) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:50:58.232868 [ 3780 ] {b866ab26-6877-4e89-85a5-573651c2024f} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=27, jobs=27). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:51:02.744433 [ 3780 ] {08166614-235e-4fdf-b253-ed2a05bfd2fc} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:55188) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:51:02.772897 [ 3780 ] {08166614-235e-4fdf-b253-ed2a05bfd2fc} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:51:06.841288 [ 3604 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:07.538638 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/yjr/wsohduzxunheucynpjlyvsjrazztk, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id defbd653-5850-4c22-aad9-19fd16587c00, upload has finished false.
2025.03.05 22:51:07.539437 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/yjr/wsohduzxunheucynpjlyvsjrazztk, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id defbd653-5850-4c22-aad9-19fd16587c00, upload has finished false
2025.03.05 22:51:07.601827 [ 3546 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/yjr/wsohduzxunheucynpjlyvsjrazztk, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id defbd653-5850-4c22-aad9-19fd16587c00, upload has finished false
2025.03.05 22:51:07.628639 [ 3546 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 36 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:08.291801 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=5). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:16.765260 [ 3780 ] {e10363c1-dd65-4c45-aca1-e240412e2635} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=8). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:58812) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:51:16.967108 [ 3780 ] {e10363c1-dd65-4c45-aca1-e240412e2635} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=8). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:51:17.350523 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fe5b5b83-eea3-482d-90c9-5c8d7754068a::202503_1_141_53}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:18.160363 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/tqf/eqmdqswbqjsberruwenegdivfixbn, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e446b5e7-cb19-4881-9211-66c257c66b73, upload has finished false.
2025.03.05 22:51:18.161226 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/tqf/eqmdqswbqjsberruwenegdivfixbn, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e446b5e7-cb19-4881-9211-66c257c66b73, upload has finished false
2025.03.05 22:51:18.229693 [ 3540 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/tqf/eqmdqswbqjsberruwenegdivfixbn, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id e446b5e7-cb19-4881-9211-66c257c66b73, upload has finished false
2025.03.05 22:51:18.271423 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 36 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:18.832867 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:21.409840 [ 3780 ] {db8a4291-3baa-439d-a167-62ad07dfc3b8} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=28, jobs=28). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:58822) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:51:21.435466 [ 3780 ] {db8a4291-3baa-439d-a167-62ad07dfc3b8} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=28, jobs=28). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:51:24.312593 [ 3636 ] {} <Error> void DB::SystemLog<DB::AsynchronousMetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::AsynchronousMetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:25.488196 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:25.842876 [ 3604 ] {} <Error> void DB::SystemLog<DB::MetricLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::MetricLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:26.393728 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column Hits): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_1_1_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6658): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:27.170091 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/was/fohikwlkewpfwhlwdxlcmqwhkfwkw, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 1b2d9288-b559-49be-8bdf-8e2f13445b3e, upload has finished false.
2025.03.05 22:51:27.184272 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/was/fohikwlkewpfwhlwdxlcmqwhkfwkw, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 1b2d9288-b559-49be-8bdf-8e2f13445b3e, upload has finished false
2025.03.05 22:51:27.223657 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/was/fohikwlkewpfwhlwdxlcmqwhkfwkw, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 1b2d9288-b559-49be-8bdf-8e2f13445b3e, upload has finished false
2025.03.05 22:51:27.277977 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 25 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:27.775960 [ 3605 ] {} <Error> void DB::SystemLog<DB::QueryLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::QueryLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:28.544527 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column n): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 0 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:29.663949 [ 3633 ] {} <Error> void DB::SystemLog<DB::TraceLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:147: DB::IMergeTreeDataPart::MinMaxIndex::store(std::vector<String, std::allocator<String>> const&, std::vector<std::shared_ptr<DB::IDataType const>, std::allocator<std::shared_ptr<DB::IDataType const>>> const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caabe19
21. /build/src/Storages/MergeTree/IMergeTreeDataPart.cpp:118: DB::IMergeTreeDataPart::MinMaxIndex::store(DB::MergeTreeData const&, DB::IDataPartStorage&, DB::MergeTreeDataPartChecksums&) const @ 0x000000001caaa7fb
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:244: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf38acf
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
25. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
26. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
27. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
28. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
30. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:29.929938 [ 3551 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column CounterID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_2_2_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 0 with max_rows_to_read = 6592): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:30.630616 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:30.870305 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 3 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:35.039012 [ 3780 ] {af59e2da-7d50-47ae-89aa-fbb4798810bf} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=22, jobs=22). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46716) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:51:35.073443 [ 3780 ] {af59e2da-7d50-47ae-89aa-fbb4798810bf} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=22, jobs=22). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:51:39.396951 [ 3780 ] {1e34b7f3-eaf2-4a6f-ad90-53d153496931} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:46730) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:51:39.420811 [ 3780 ] {1e34b7f3-eaf2-4a6f-ad90-53d153496931} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=34, jobs=34). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:51:41.062572 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/ltw/aecoobzlyvzywkfjoyddclxkgdomk, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id c58826a7-b8e0-4dae-9d6b-7ffd8e7e6303, upload has finished false.
2025.03.05 22:51:41.063738 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/ltw/aecoobzlyvzywkfjoyddclxkgdomk, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id c58826a7-b8e0-4dae-9d6b-7ffd8e7e6303, upload has finished false
2025.03.05 22:51:41.130299 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/ltw/aecoobzlyvzywkfjoyddclxkgdomk, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id c58826a7-b8e0-4dae-9d6b-7ffd8e7e6303, upload has finished false
2025.03.05 22:51:41.199727 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 36 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:48.430742 [ 3780 ] {b7c0d020-7133-4b90-8ea5-42d41ec72599} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:50726) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:51:48.464150 [ 3780 ] {b7c0d020-7133-4b90-8ea5-42d41ec72599} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:51:49.922234 [ 3583 ] {} <Warning> system.trace_log (0d6617f8-564f-43ff-a6dc-a74b9f150261): Removing temporary directory /var/lib/clickhouse/disks/s3/store/0d6/0d6617f8-564f-43ff-a6dc-a74b9f150261/tmp_merge_202503_113_157_9/
2025.03.05 22:51:49.922834 [ 3583 ] {} <Warning> system.trace_log (0d6617f8-564f-43ff-a6dc-a74b9f150261): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/0d6/0d6617f8-564f-43ff-a6dc-a74b9f150261/tmp_merge_202503_113_157_9/
2025.03.05 22:51:49.981297 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {0d6617f8-564f-43ff-a6dc-a74b9f150261::202503_113_157_9}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:296: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1c93
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:53.040216 [ 3780 ] {298550ee-7e61-4bf1-855a-4ea4f9c8bd9a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=32, jobs=32). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34380) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:51:53.065412 [ 3780 ] {298550ee-7e61-4bf1-855a-4ea4f9c8bd9a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=32, jobs=32). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:51:53.318762 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/iwc/ofwidukzrqpjtuomzeyfdudnhsqml, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id a4bfdf67-49ec-4d88-8e54-ed31eeb91f1f, upload has finished false.
2025.03.05 22:51:53.319564 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/iwc/ofwidukzrqpjtuomzeyfdudnhsqml, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id a4bfdf67-49ec-4d88-8e54-ed31eeb91f1f, upload has finished false
2025.03.05 22:51:53.483308 [ 3554 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/iwc/ofwidukzrqpjtuomzeyfdudnhsqml, total size 167772160, count 167772160, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id a4bfdf67-49ec-4d88-8e54-ed31eeb91f1f, upload has finished false
2025.03.05 22:51:53.499442 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 38 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:57.011464 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 4 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:51:57.409657 [ 3780 ] {3089d62f-57e1-4577-8394-9f60424a0dcd} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=33, jobs=33). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:34386) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:51:57.435601 [ 3780 ] {3089d62f-57e1-4577-8394-9f60424a0dcd} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=33, jobs=33). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:51:58.422952 [ 3613 ] {} <Error> void DB::SystemLog<DB::PartLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::PartLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:294: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf396b6
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:01.331658 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/vov/lrmyoobzexusccpojeboatehbhmef, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 109415b0-e3ae-4106-827d-2435bb0e9351, upload has finished false.
2025.03.05 22:52:01.332442 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/vov/lrmyoobzexusccpojeboatehbhmef, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 109415b0-e3ae-4106-827d-2435bb0e9351, upload has finished false
2025.03.05 22:52:01.361474 [ 3544 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/vov/lrmyoobzexusccpojeboatehbhmef, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 109415b0-e3ae-4106-827d-2435bb0e9351, upload has finished false
2025.03.05 22:52:01.400175 [ 3544 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 13 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:04.719808 [ 3542 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 5 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:07.612660 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=1): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 4 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:07.841275 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=50, jobs=3). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<std::shared_ptr<DB::MarksInCompressedFile>> (DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority)::operator()(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, Priority) @ 0x000000001ce1ea91
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce1e93b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001ce1e8f0
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce1e8b0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce1e83b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001ce204d1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001ce1e550
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<std::shared_ptr<DB::MarksInCompressedFile>> DB::scheduleFromThreadPoolUnsafe<std::shared_ptr<DB::MarksInCompressedFile>, DB::MergeTreeMarksLoader::loadMarksAsync()::$_0>(DB::MergeTreeMarksLoader::loadMarksAsync()::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x000000001ce1de9c
17. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:234: DB::MergeTreeMarksLoader::loadMarksAsync() @ 0x000000001ce1c4c3
18. /build/src/Storages/MergeTree/MergeTreeMarksLoader.cpp:69: DB::MergeTreeMarksLoader::MergeTreeMarksLoader(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>, DB::MarkCache*, String const&, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool, DB::ReadSettings const&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*, unsigned long) @ 0x000000001ce1c3b3
19. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::MergeTreeMarksLoader* std::construct_at[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, DB::MergeTreeMarksLoader*>(DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dcac
20. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::MergeTreeMarksLoader>>::construct[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void, void>(std::allocator<DB::MergeTreeMarksLoader>&, DB::MergeTreeMarksLoader*, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dbb5
21. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>>::__shared_ptr_emplace[abi:v15000]<std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int>(std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6dae3
22. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::MergeTreeMarksLoader> std::allocate_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::allocator<DB::MergeTreeMarksLoader>, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::allocator<DB::MergeTreeMarksLoader> const&, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d995
23. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::MergeTreeMarksLoader> std::make_shared[abi:v15000]<DB::MergeTreeMarksLoader, std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String, unsigned long, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int, void>(std::shared_ptr<DB::IMergeTreeDataPartInfoForReader>&, DB::MarkCache* const&, String&&, unsigned long&&, DB::MergeTreeIndexGranularityInfo const&, bool&, DB::ReadSettings&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>*&, int&&) @ 0x000000001ce6d29b
24. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:231: DB::MergeTreeReaderWide::addStreams(DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, std::function<void (DB::ReadBufferFromFileBase::ProfileInfo)> const&, int)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6acd3
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6a9dd
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6a99d
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6a95d
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6a928
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
31. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:09.766253 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 3 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:11.332648 [ 3780 ] {7e660908-a0c0-41d6-bd15-dbcd2b633f25} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:40038) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:52:11.360562 [ 3780 ] {7e660908-a0c0-41d6-bd15-dbcd2b633f25} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=9, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:52:12.465189 [ 3541 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 5 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:13.168754 [ 3633 ] {} <Error> void DB::SystemLog<DB::TraceLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:323: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf39c44
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:17.063568 [ 3553 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column Referer): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_1_1_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 1 with max_rows_to_read = 6658): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:20.261682 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=1): (while reading column UserID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_2_2_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 1 with max_rows_to_read = 6592): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:20.574343 [ 3780 ] {73bc6a01-6e8d-4334-8d77-6636ee239d4a} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:56314) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:52:20.668876 [ 3780 ] {73bc6a01-6e8d-4334-8d77-6636ee239d4a} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:52:20.872018 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/lhq/danwklfvvdbdetnylhcskkmcwcxmf, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b17da59a-07ea-4845-88de-acc1f8614339, upload has finished false.
2025.03.05 22:52:20.872807 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/lhq/danwklfvvdbdetnylhcskkmcwcxmf, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b17da59a-07ea-4845-88de-acc1f8614339, upload has finished false
2025.03.05 22:52:20.913700 [ 3555 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/lhq/danwklfvvdbdetnylhcskkmcwcxmf, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id b17da59a-07ea-4845-88de-acc1f8614339, upload has finished false
2025.03.05 22:52:20.952742 [ 3555 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 25 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:21.188352 [ 3552 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {d6e34560-791e-4c8b-afed-219ccdbc3d94::202503_138_248_20}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=9). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:45: DB::MergeTreeDataPartWriterOnDisk::Stream<false>::preFinalize() @ 0x000000001cce470d
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:644: DB::MergeTreeDataPartWriterWide::fillDataChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf1b83
22. /build/src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp:0: DB::MergeTreeDataPartWriterWide::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccf207e
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
24. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
25. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
26. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
27. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
28. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
31. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:23.154951 [ 3635 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TextLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=4). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:298: DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001ccd1caf
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd251a
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
24. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
25. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
26. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
27. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:23.299214 [ 3549 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {36f6b282-d63c-4339-a45a-eaaadc6bcc92::201403_1_6_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column VisitID): (while reading from part /var/lib/clickhouse/disks/s3_disk/store/36f/36f6b282-d63c-4339-a45a-eaaadc6bcc92/201403_4_4_0/ in table test.visits (36f6b282-d63c-4339-a45a-eaaadc6bcc92) located on disk s3_disk of type s3, from mark 1 with max_rows_to_read = 6741): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:25.623903 [ 3780 ] {6f6311be-4bab-4f3e-b9df-4d45f6cc9c08} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=15, jobs=15). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38864) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:52:25.649247 [ 3780 ] {6f6311be-4bab-4f3e-b9df-4d45f6cc9c08} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=15, jobs=15). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:52:26.955218 [ 3540 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {fe5b5b83-eea3-482d-90c9-5c8d7754068a::202503_1_149_61}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=2). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergeTreeDataPartWriterOnDisk.cpp:442: DB::MergeTreeDataPartWriterOnDisk::fillPrimaryIndexChecksums(DB::MergeTreeDataPartChecksums&) @ 0x000000001cce26ba
21. /build/src/Storages/MergeTree/MergeTreeDataPartWriterCompact.cpp:0: DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&, std::unordered_set<String, std::hash<String>, std::equal_to<String>, std::allocator<String>>&) @ 0x000000001ccd2538
22. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:153: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36e3a
23. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:136: DB::MergedBlockOutputStream::finalizePart(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf36d43
24. /build/src/Storages/MergeTree/MergeTask.cpp:815: DB::MergeTask::MergeProjectionsStage::finalizeProjectionsAndWholeMerge() const @ 0x000000001cb710bf
25. /build/src/Storages/MergeTree/MergeTask.cpp:840: DB::MergeTask::MergeProjectionsStage::execute() @ 0x000000001cb713d8
26. /build/src/Storages/MergeTree/MergeTask.cpp:889: DB::MergeTask::execute() @ 0x000000001cb70db2
27. /build/src/Storages/MergeTree/MergePlainMergeTreeTask.cpp:57: DB::MergePlainMergeTreeTask::executeStep() @ 0x000000001d13dd38
28. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:282: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::routine(std::shared_ptr<DB::TaskRuntimeData>) @ 0x000000001cba03ed
29. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:348: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::threadFunction() @ 0x000000001cba0f0e
30. /build/src/Storages/MergeTree/MergeTreeBackgroundExecutor.cpp:57: DB::MergeTreeBackgroundExecutor<DB::DynamicRuntimeQueue>::MergeTreeBackgroundExecutor(String, unsigned long, unsigned long, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, StrongTypedef<unsigned long, CurrentMetrics::MetricTag>, std::basic_string_view<char, std::char_traits<char>>)::'lambda'()::operator()() const @ 0x000000001cba8a78
31. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001cba8a55
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:28.352117 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/jig/qawmsagcgczubtopkfqbaojnukohm, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 93d184a4-8742-4163-8a59-3650dc913041, upload has finished false.
2025.03.05 22:52:28.352852 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/jig/qawmsagcgczubtopkfqbaojnukohm, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 93d184a4-8742-4163-8a59-3650dc913041, upload has finished false
2025.03.05 22:52:28.417027 [ 3548 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/jig/qawmsagcgczubtopkfqbaojnukohm, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 93d184a4-8742-4163-8a59-3650dc913041, upload has finished false
2025.03.05 22:52:28.556807 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 28 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:30.026030 [ 3780 ] {3b55ab0a-14d8-4366-9638-85c1091b2241} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=29, jobs=29). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:38870) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:52:30.082816 [ 3780 ] {3b55ab0a-14d8-4366-9638-85c1091b2241} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=29, jobs=29). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:52:30.873006 [ 3548 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_4_4_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 3 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:34.506086 [ 3780 ] {fedf5513-3e33-466d-b524-d95aade795e4} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=28, jobs=14). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42632) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:52:34.617152 [ 3780 ] {fedf5513-3e33-466d-b524-d95aade795e4} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=28, jobs=14). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:404: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x000000001d513c45
11. /build/src/Processors/Executors/PipelineExecutor.cpp:111: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001d5130b6
12. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:83: DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool) @ 0x000000001d538b70
13. /build/src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:110: DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const @ 0x000000001d5389df
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538955
15. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&, std::__tuple_indices<>) @ 0x000000001d538939
16. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::tuple<>&) @ 0x000000001d53889d
17. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<true>::ThreadFromGlobalPoolImpl<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() @ 0x000000001d5387a7
18. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d538715
19. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d5386f5
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d5386d5
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d5386a0
22. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
23. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
24. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1
25. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133dc104
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133dc0b5
27. /build/contrib/llvm-project/libcxx/include/thread:285: void std::__thread_execute[abi:v15000]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(std::tuple<void, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>&, std::__tuple_indices<>) @ 0x00000000133dc07d
28. /build/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15000]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void ThreadPoolImpl<std::thread>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>>(void*) @ 0x00000000133dbe82
29. ? @ 0x00007f7a996d8ac3
30. ? @ 0x00007f7a9976a850

2025.03.05 22:52:35.580862 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/kst/vwlgawdqjugcdgphszznzfgqolmcf, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id f0984abb-3b2c-4412-9861-6a19e726763d, upload has finished false.
2025.03.05 22:52:35.581622 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/kst/vwlgawdqjugcdgphszznzfgqolmcf, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id f0984abb-3b2c-4412-9861-6a19e726763d, upload has finished false
2025.03.05 22:52:35.608165 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/kst/vwlgawdqjugcdgphszznzfgqolmcf, total size 50331648, count 50331648, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id f0984abb-3b2c-4412-9861-6a19e726763d, upload has finished false
2025.03.05 22:52:35.634861 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_5_5_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 13 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:38.476583 [ 3587 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Removing temporary directory /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:52:38.480982 [ 3587 ] {} <Warning> test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61): Since zero-copy replication is enabled we are not going to remove blobs from shared storage for /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/tmp_merge_all_1_5_1/
2025.03.05 22:52:38.522467 [ 3554 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 4 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:39.050065 [ 3633 ] {} <Error> void DB::SystemLog<DB::TraceLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::TraceLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=1). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:302: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf397cc
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:43.699903 [ 3780 ] {5cfa30d8-9ad1-49c6-b22a-70d072733469} <Error> executeQuery: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK) (version 24.3.12.76.altinitystable) (from [::1]:42460) (comment: 01088_window_view_default_column.sh) (in query: SELECT count(*) FROM dst), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:52:43.726117 [ 3780 ] {5cfa30d8-9ad1-49c6-b22a-70d072733469} <Error> TCPHandler: Code: 439. DB::Exception: Cannot schedule a task: cannot allocate thread (threads=13, jobs=13). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:263: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d601e
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Processors/Executors/PipelineExecutor.cpp:360: DB::PipelineExecutor::spawnThreads() @ 0x000000001d515b07
10. /build/src/Processors/Executors/PipelineExecutor.cpp:306: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000001d514e31
11. /build/src/Processors/Executors/PipelineExecutor.cpp:239: DB::PipelineExecutor::executeSingleThread(unsigned long) @ 0x000000001d515037
12. /build/src/Processors/Executors/PipelineExecutor.cpp:373: DB::PipelineExecutor::spawnThreads()::$_0::operator()() const @ 0x000000001d515fd8
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d515f35
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001d515f15
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d515ef5
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d515ec0
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
19. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
20. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
21. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
22. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
23. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
24. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
25. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
26. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
31. /build/src/Common/ThreadPool.cpp:536: ThreadPoolImpl<std::thread>::worker(std::__list_iterator<std::thread, void*>) @ 0x00000000133d46b1

2025.03.05 22:52:45.718381 [ 3608 ] {} <Error> void DB::SystemLog<DB::ProcessorProfileLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) [LogElement = DB::ProcessorProfileLogElement]: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=26, jobs=0). (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<void> (std::function<void ()>&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<void, std::function<void ()>>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(std::function<void ()>&&, Priority)::operator()(std::function<void ()>&&, Priority) @ 0x00000000198c9eb6
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000198c9d5b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000198c9d10
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000198c9cd0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000198c9c7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000013396651
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000013391d70
16. /build/src/Common/ThreadPoolTaskTracker.cpp:130: DB::TaskTracker::add(std::function<void ()>&&) @ 0x0000000019370743
17. /build/src/IO/WriteBufferFromS3.cpp:739: DB::WriteBufferFromS3::makeSinglepartUpload(DB::WriteBufferFromS3::PartData&&) @ 0x00000000199087ab
18. /build/src/IO/WriteBufferFromS3.cpp:180: DB::WriteBufferFromS3::preFinalize() @ 0x0000000019907f0f
19. /build/src/IO/WriteBufferFromFileDecorator.cpp:62: DB::WriteBufferFromFileDecorator::preFinalize() @ 0x000000001a35771e
20. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:286: DB::MergedBlockOutputStream::finalizePartOnDisk(std::shared_ptr<DB::IMergeTreeDataPart> const&, DB::MergeTreeDataPartChecksums&) @ 0x000000001cf394fb
21. /build/src/Storages/MergeTree/MergedBlockOutputStream.cpp:180: DB::MergedBlockOutputStream::finalizePartAsync(std::shared_ptr<DB::IMergeTreeDataPart> const&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x000000001cf37d99
22. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:628: DB::MergeTreeDataWriter::writeTempPartImpl(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>, long, bool) @ 0x000000001cf860b3
23. /build/src/Storages/MergeTree/MergeTreeDataWriter.cpp:404: DB::MergeTreeDataWriter::writeTempPart(DB::BlockWithPartition&, std::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::shared_ptr<DB::Context const>) @ 0x000000001cf8245d
24. /build/src/Storages/MergeTree/MergeTreeSink.cpp:86: DB::MergeTreeSink::consume(DB::Chunk) @ 0x000000001d13ab8f
25. /build/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x000000001dbbc425
26. /build/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work()::$_1::operator()() const @ 0x000000001da409fc
27. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001da409b5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001da40995
29. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001da40975
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001da4093d
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:47.193862 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/lnf/gazohttqredpbsyistxixoxnjlqxs, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 3585fc6d-7ca1-49e5-9b6b-f55255fab7c3, upload has finished false.
2025.03.05 22:52:47.195080 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/lnf/gazohttqredpbsyistxixoxnjlqxs, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 3585fc6d-7ca1-49e5-9b6b-f55255fab7c3, upload has finished false
2025.03.05 22:52:47.308345 [ 3543 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/lnf/gazohttqredpbsyistxixoxnjlqxs, total size 117440512, count 117440512, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 3585fc6d-7ca1-49e5-9b6b-f55255fab7c3, upload has finished false
2025.03.05 22:52:47.326351 [ 3543 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_3_3_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 28 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:52:52.857589 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key test/iad/qucobvlwlgepfkdyzaxlojpmnnxtp, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 542e4295-0f92-4de3-8d01-688b3d2f32de, upload has finished false.
2025.03.05 22:52:52.858367 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key test/iad/qucobvlwlgepfkdyzaxlojpmnnxtp, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 542e4295-0f92-4de3-8d01-688b3d2f32de, upload has finished false
2025.03.05 22:52:52.890764 [ 3541 ] {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key test/iad/qucobvlwlgepfkdyzaxlojpmnnxtp, total size 67108864, count 67108864, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 542e4295-0f92-4de3-8d01-688b3d2f32de, upload has finished false
2025.03.05 22:52:52.930896 [ 3541 ] {} <Error> MergeTreeBackgroundExecutor: Exception while executing background task {ed03e3cc-d365-4270-bd78-ad1aa46aad61::all_1_5_1}: Code: 439. DB::Exception: Cannot schedule a task: fault injected (threads=72, jobs=0): (while reading column s): (while reading from part /var/lib/clickhouse/disks/s3/store/ed0/ed03e3cc-d365-4270-bd78-ad1aa46aad61/all_2_2_0/ in table test_15.`02725_memory_for_merges` (ed03e3cc-d365-4270-bd78-ad1aa46aad61) located on disk s3 of type s3, from mark 16 with max_rows_to_read = 1): While executing MergeTreeSequentialSource. (CANNOT_SCHEDULE_TASK), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, unsigned long, unsigned long&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type, std::type_identity<unsigned long&>::type>, String const&, unsigned long&&, unsigned long&) @ 0x00000000133db868
6. /build/src/Common/ThreadPool.cpp:203: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda'(String const&)::operator()(String const&) const @ 0x00000000133e082d
7. /build/src/Common/ThreadPool.cpp:219: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool) @ 0x00000000133d5a18
8. /build/src/Common/ThreadPool.cpp:326: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleOrThrowOnError(std::function<void ()>, Priority) @ 0x00000000133d589c
9. /build/src/Common/threadPoolCallbackRunner.h:60: std::function<std::future<DB::IAsynchronousReader::Result> (DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)> DB::threadPoolCallbackRunnerUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&)::'lambda'(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority)::operator()(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, Priority) @ 0x00000000190e80e1
10. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000190e7f7b
11. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x00000000190e7f30
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000190e7ef0
13. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000190e7e7b
14. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000190e9bb1
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000190e7b90
16. /build/src/Common/threadPoolCallbackRunner.h:70: std::future<DB::IAsynchronousReader::Result> DB::scheduleFromThreadPoolUnsafe<DB::IAsynchronousReader::Result, DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0>(DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request)::$_0&&, ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>&, String const&, Priority) @ 0x00000000190e741c
17. /build/src/Disks/IO/ThreadPoolRemoteFSReader.cpp:109: DB::ThreadPoolRemoteFSReader::submit(DB::IAsynchronousReader::Request) @ 0x00000000190e6c3f
18. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:90: DB::AsynchronousBoundedReadBuffer::readAsync(char*, unsigned long, Priority) @ 0x0000000019364112
19. /build/src/Disks/IO/AsynchronousBoundedReadBuffer.cpp:116: DB::AsynchronousBoundedReadBuffer::prefetch(Priority) @ 0x000000001936441e
20. /build/src/Compression/CompressedReadBufferFromFile.cpp:57: DB::CompressedReadBufferFromFile::prefetch(Priority) @ 0x0000000019ddb24d
21. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:331: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&)::$_0::operator()(DB::ISerialization::SubstreamPath const&) const @ 0x000000001ce6bf68
22. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001ce6bdbd
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001ce6bd7d
24. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001ce6bd3d
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001ce6bd08
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000019fd587e
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000019fd1cfd
28. /build/src/DataTypes/Serializations/ISerialization.cpp:93: DB::ISerialization::enumerateStreams(DB::ISerialization::EnumerateStreamsSettings&, std::function<void (DB::ISerialization::SubstreamPath const&)> const&, DB::ISerialization::SubstreamData const&) const @ 0x0000000019fcf0d6
29. /build/src/DataTypes/Serializations/ISerialization.cpp:103: DB::ISerialization::enumerateStreams(std::function<void (DB::ISerialization::SubstreamPath const&)> const&, std::shared_ptr<DB::IDataType const> const&, COW<DB::IColumn>::immutable_ptr<DB::IColumn> const&) const @ 0x0000000019fcf25c
30. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:322: DB::MergeTreeReaderWide::prefetchForColumn(Priority, DB::NameAndTypePair const&, std::shared_ptr<DB::ISerialization const> const&, unsigned long, bool, unsigned long, std::unordered_map<String, COW<DB::IColumn>::immutable_ptr<DB::IColumn>, std::hash<String>, std::equal_to<String>, std::allocator<std::pair<String const, COW<DB::IColumn>::immutable_ptr<DB::IColumn>>>>&) @ 0x000000001ce6999b
31. /build/src/Storages/MergeTree/MergeTreeReaderWide.cpp:103: DB::MergeTreeReaderWide::prefetchForAllColumns(Priority, unsigned long, unsigned long, unsigned long, bool) @ 0x000000001ce69710
 (version 24.3.12.76.altinitystable)
2025.03.05 22:53:03.031779 [ 3542 ] {} <Warning> WriteBufferFromS3: WriteBufferFromS3 was neither finished nor aborted, try to abort upload in destructor. Details: bucket test, key s3/vyy/gsgapdgawuxfscfujrodqosoqhrva, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 965b7c1f-0f1b-4668-a09b-0d68525d8035, upload has finished false.
2025.03.05 22:53:03.031911 [ 3542 ] {} <Warning> WriteBufferFromS3: Abort multipart upload. Details: bucket test, key s3/vyy/gsgapdgawuxfscfujrodqosoqhrva, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 965b7c1f-0f1b-4668-a09b-0d68525d8035, upload has finished false
2025.03.05 22:53:03.064994 [ 3542 ] {} <Warning> WriteBufferFromS3: Multipart upload has aborted successfully. Details: bucket test, key s3/vyy/gsgapdgawuxfscfujrodqosoqhrva, total size 100663296, count 100663296, hidden_size 0, offset 0, with pool: true, prefinalized false, finalized false, upload id 965b7c1f-0f1b-4668-a09b-0d68525d8035, upload has finished false
2025.03.05 22:58:05.604976 [ 11535 ] {ce47d78d-064e-4115-b2b0-317ca467a0e6} <Error> executeQuery: Code: 521. DB::ErrnoException: Cannot rename /var/lib/clickhouse/metadata/test.sql.tmp to /var/lib/clickhouse/metadata/test.sql because the second path already exists: , errno: 17, strerror: File exists. (ATOMIC_RENAME_FAIL) (version 24.3.12.76.altinitystable) (from [::1]:38726) (in query: CREATE DATABASE IF NOT EXISTS test ), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:194: DB::ErrnoException::ErrnoException<String const&, String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String const&>::type>, String const&, String const&) @ 0x000000001a0d3ecc
6. /build/src/Common/atomicRename.cpp:90: DB::renameat2(String const&, String const&, int) @ 0x000000001a0d3912
7. /build/src/Common/atomicRename.cpp:211: DB::renameNoReplace(String const&, String const&) @ 0x000000001a0d3702
8. /build/src/Interpreters/InterpreterCreateQuery.cpp:330: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b009eb0
9. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe3f
10. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
11. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
12. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
13. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850

2025.03.05 22:58:05.606213 [ 11535 ] {ce47d78d-064e-4115-b2b0-317ca467a0e6} <Error> DynamicQueryHandler: Code: 521. DB::ErrnoException: Cannot rename /var/lib/clickhouse/metadata/test.sql.tmp to /var/lib/clickhouse/metadata/test.sql because the second path already exists: , errno: 17, strerror: File exists. (ATOMIC_RENAME_FAIL), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:194: DB::ErrnoException::ErrnoException<String const&, String const&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String const&>::type>, String const&, String const&) @ 0x000000001a0d3ecc
6. /build/src/Common/atomicRename.cpp:90: DB::renameat2(String const&, String const&, int) @ 0x000000001a0d3912
7. /build/src/Common/atomicRename.cpp:211: DB::renameNoReplace(String const&, String const&) @ 0x000000001a0d3702
8. /build/src/Interpreters/InterpreterCreateQuery.cpp:330: DB::InterpreterCreateQuery::createDatabase(DB::ASTCreateQuery&) @ 0x000000001b009eb0
9. /build/src/Interpreters/InterpreterCreateQuery.cpp:1791: DB::InterpreterCreateQuery::execute() @ 0x000000001b01fe3f
10. /build/src/Interpreters/executeQuery.cpp:1195: DB::executeQueryImpl(char const*, char const*, std::shared_ptr<DB::Context>, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000001bbb14d7
11. /build/src/Interpreters/executeQuery.cpp:1496: DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, std::shared_ptr<DB::Context>, std::function<void (DB::QueryResultDetails const&)>, DB::QueryFlags, std::optional<DB::FormatSettings> const&, std::function<void (DB::IOutputFormat&)>) @ 0x000000001bbb3c89
12. /build/src/Server/HTTPHandler.cpp:891: DB::HTTPHandler::processQuery(DB::HTTPServerRequest&, DB::HTMLForm&, DB::HTTPServerResponse&, DB::HTTPHandler::Output&, std::optional<DB::CurrentThread::QueryScope>&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3d9289
13. /build/src/Server/HTTPHandler.cpp:1090: DB::HTTPHandler::handleRequest(DB::HTTPServerRequest&, DB::HTTPServerResponse&, StrongTypedef<unsigned long, ProfileEvents::EventTag> const&) @ 0x000000001d3dc370
14. /build/src/Server/HTTP/HTTPServerConnection.cpp:70: DB::HTTPServerConnection::run() @ 0x000000001d494dc7
15. /build/base/poco/Net/src/TCPServerConnection.cpp:43: Poco::Net::TCPServerConnection::start() @ 0x00000000228abcd9
16. /build/base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x00000000228ac528
17. /build/base/poco/Foundation/src/ThreadPool.cpp:188: Poco::PooledThread::run() @ 0x0000000022a83854
18. /build/base/poco/Foundation/src/Thread.cpp:46: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000022a805fa
19. /build/base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000022a7f33e
20. ? @ 0x00007f7a996d8ac3
21. ? @ 0x00007f7a9976a850
 (version 24.3.12.76.altinitystable)
2025.03.05 22:58:33.735500 [ 2806 ] {} <Warning> Application: Closed all listening sockets. Waiting for 9 outstanding connections.
2025.03.05 22:58:38.640490 [ 2806 ] {} <Warning> Application: Closed connections. But 9 remain. Tip: To increase wait time add to config: <shutdown_wait_unfinished>60</shutdown_wait_unfinished>
2025.03.05 22:58:38.640698 [ 2806 ] {} <Warning> Application: Will shutdown forcefully.
2025.03.05 22:58:41.216374 [ 11589 ] {} <Warning> Context: Server was built in debug mode. It will work slowly.
2025.03.05 22:58:41.246681 [ 11589 ] {} <Warning> Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production.
2025.03.05 22:58:41.248545 [ 11589 ] {} <Warning> Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl.
2025.03.05 22:58:41.251248 [ 11589 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2025.03.05 22:58:41.251417 [ 11589 ] {} <Warning> Application: Integrity check of the executable skipped because the reference checksum could not be read.
2025.03.05 22:58:43.849283 [ 11589 ] {} <Warning> CloudPlacementInfo: Placement info has not been loaded
2025.03.05 22:58:44.244804 [ 11589 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2025.03.05 22:58:44.250874 [ 11589 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2025.03.05 22:58:44.250971 [ 11589 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2025.03.05 22:58:44.302379 [ 12235 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2025.03.05 22:58:47.979919 [ 11589 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2025.03.05 22:58:48.488808 [ 11589 ] {} <Warning> loadMetadata: Removing temporary file /var/lib/clickhouse/metadata/test.sql.tmp
2025.03.05 22:58:48.809882 [ 11589 ] {} <Warning> TablesLoader: Tables test_9.dist_01213 depend on default.id, but seems like that does not exist. Will ignore it and try to load existing tables
2025.03.05 22:58:49.289290 [ 12370 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 22:58:49.289485 [ 12337 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_9`.`wv` from metadata file /var/lib/clickhouse/store/09d/09d98515-dd90-4fc5-b303-a84ab6dcf315/wv.sql from query ATTACH WINDOW VIEW test_9.wv UUID '0745b061-58f7-49bd-817a-9cb1a1375922' TO test_9.dst (`count` UInt64, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, tumbleEnd(wid) AS w_end FROM test_9.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 22:58:58.247166 [ 12238 ] {} <Error> RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled
2025.03.05 22:58:59.875800 [ 11589 ] {} <Error> Application: Code: 696. DB::Exception: Load job 'startup table 01056_window_view_proc_hop_watch.wv' -> Code: 695. DB::Exception: Load job 'load table 01056_window_view_proc_hop_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED) (version 24.3.12.76.altinitystable). (ASYNC_LOAD_CANCELED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Common/AsyncLoader.cpp:73: DB::cancelOnDependencyFailure(std::shared_ptr<DB::LoadJob> const&, std::shared_ptr<DB::LoadJob> const&, std::exception_ptr&) @ 0x00000000135e6076
7. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0d21ed
8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0d21ad
9. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0d216d
10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0d2115
11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001360214e
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f568d
13. /build/src/Common/AsyncLoader.cpp:627: DB::AsyncLoader::finish(std::shared_ptr<DB::LoadJob> const&, DB::LoadStatus, std::exception_ptr, std::unique_lock<std::mutex>&) @ 0x00000000135ed01f
14. /build/src/Common/AsyncLoader.cpp:898: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f181e
15. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f40b5
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f4095
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f4075
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f403d
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
22. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
23. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
25. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
26. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
27. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
 (version 24.3.12.76.altinitystable)
2025.03.05 22:59:01.192142 [ 12435 ] {} <Warning> Context: Server was built in debug mode. It will work slowly.
2025.03.05 22:59:01.222031 [ 12435 ] {} <Warning> Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production.
2025.03.05 22:59:01.223264 [ 12435 ] {} <Warning> Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl.
2025.03.05 22:59:01.225916 [ 12435 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2025.03.05 22:59:01.226062 [ 12435 ] {} <Warning> Application: Integrity check of the executable skipped because the reference checksum could not be read.
2025.03.05 22:59:06.041629 [ 12435 ] {} <Warning> CloudPlacementInfo: Placement info has not been loaded
2025.03.05 22:59:06.429411 [ 12435 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2025.03.05 22:59:06.435059 [ 12435 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2025.03.05 22:59:06.435153 [ 12435 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2025.03.05 22:59:06.486631 [ 13087 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2025.03.05 22:59:10.138190 [ 12435 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2025.03.05 22:59:11.569249 [ 12435 ] {} <Warning> TablesLoader: Tables test_9.dist_01213 depend on default.id, but seems like that does not exist. Will ignore it and try to load existing tables
2025.03.05 22:59:12.046002 [ 13272 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 22:59:20.433733 [ 13090 ] {} <Error> RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled
2025.03.05 22:59:22.079449 [ 12435 ] {} <Error> Application: Code: 696. DB::Exception: Load job 'startup table 01056_window_view_proc_hop_watch.wv' -> Code: 695. DB::Exception: Load job 'load table 01056_window_view_proc_hop_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED) (version 24.3.12.76.altinitystable). (ASYNC_LOAD_CANCELED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Common/AsyncLoader.cpp:73: DB::cancelOnDependencyFailure(std::shared_ptr<DB::LoadJob> const&, std::shared_ptr<DB::LoadJob> const&, std::exception_ptr&) @ 0x00000000135e6076
7. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0d21ed
8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0d21ad
9. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0d216d
10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0d2115
11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001360214e
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f568d
13. /build/src/Common/AsyncLoader.cpp:627: DB::AsyncLoader::finish(std::shared_ptr<DB::LoadJob> const&, DB::LoadStatus, std::exception_ptr, std::unique_lock<std::mutex>&) @ 0x00000000135ed01f
14. /build/src/Common/AsyncLoader.cpp:898: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f181e
15. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f40b5
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f4095
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f4075
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f403d
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
22. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
23. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
25. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
26. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
27. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
 (version 24.3.12.76.altinitystable)
2025.03.05 22:59:23.360700 [ 13287 ] {} <Warning> Context: Server was built in debug mode. It will work slowly.
2025.03.05 22:59:23.390436 [ 13287 ] {} <Warning> Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production.
2025.03.05 22:59:23.391610 [ 13287 ] {} <Warning> Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl.
2025.03.05 22:59:23.394177 [ 13287 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2025.03.05 22:59:23.394317 [ 13287 ] {} <Warning> Application: Integrity check of the executable skipped because the reference checksum could not be read.
2025.03.05 22:59:28.685955 [ 13287 ] {} <Warning> CloudPlacementInfo: Placement info has not been loaded
2025.03.05 22:59:29.102245 [ 13287 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2025.03.05 22:59:29.107969 [ 13287 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2025.03.05 22:59:29.108084 [ 13287 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2025.03.05 22:59:29.159753 [ 13941 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2025.03.05 22:59:32.774729 [ 13287 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2025.03.05 22:59:34.220238 [ 13287 ] {} <Warning> TablesLoader: Tables test_9.dist_01213 depend on default.id, but seems like that does not exist. Will ignore it and try to load existing tables
2025.03.05 22:59:34.505680 [ 14087 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 22:59:34.505784 [ 14043 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_9`.`wv` from metadata file /var/lib/clickhouse/store/09d/09d98515-dd90-4fc5-b303-a84ab6dcf315/wv.sql from query ATTACH WINDOW VIEW test_9.wv UUID '0745b061-58f7-49bd-817a-9cb1a1375922' TO test_9.dst (`count` UInt64, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, tumbleEnd(wid) AS w_end FROM test_9.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 22:59:44.734311 [ 13287 ] {} <Error> Application: Code: 696. DB::Exception: Load job 'startup table 01056_window_view_proc_hop_watch.wv' -> Code: 695. DB::Exception: Load job 'load table 01056_window_view_proc_hop_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED) (version 24.3.12.76.altinitystable). (ASYNC_LOAD_CANCELED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Common/AsyncLoader.cpp:73: DB::cancelOnDependencyFailure(std::shared_ptr<DB::LoadJob> const&, std::shared_ptr<DB::LoadJob> const&, std::exception_ptr&) @ 0x00000000135e6076
7. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0d21ed
8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0d21ad
9. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0d216d
10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0d2115
11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001360214e
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f568d
13. /build/src/Common/AsyncLoader.cpp:627: DB::AsyncLoader::finish(std::shared_ptr<DB::LoadJob> const&, DB::LoadStatus, std::exception_ptr, std::unique_lock<std::mutex>&) @ 0x00000000135ed01f
14. /build/src/Common/AsyncLoader.cpp:898: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f181e
15. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f40b5
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f4095
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f4075
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f403d
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
22. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
23. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
25. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
26. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
27. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
 (version 24.3.12.76.altinitystable)
2025.03.05 22:59:47.021938 [ 14134 ] {} <Warning> Context: Server was built in debug mode. It will work slowly.
2025.03.05 22:59:47.052698 [ 14134 ] {} <Warning> Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production.
2025.03.05 22:59:47.054169 [ 14134 ] {} <Warning> Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl.
2025.03.05 22:59:47.056880 [ 14134 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2025.03.05 22:59:47.057038 [ 14134 ] {} <Warning> Application: Integrity check of the executable skipped because the reference checksum could not be read.
2025.03.05 22:59:52.341080 [ 14134 ] {} <Warning> CloudPlacementInfo: Placement info has not been loaded
2025.03.05 22:59:52.731088 [ 14134 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2025.03.05 22:59:52.736905 [ 14134 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2025.03.05 22:59:52.736999 [ 14134 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2025.03.05 22:59:52.788681 [ 14788 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2025.03.05 22:59:57.012342 [ 14134 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2025.03.05 22:59:58.115812 [ 14134 ] {} <Warning> TablesLoader: Tables test_9.dist_01213 depend on default.id, but seems like that does not exist. Will ignore it and try to load existing tables
2025.03.05 22:59:58.350638 [ 14961 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_9`.`wv` from metadata file /var/lib/clickhouse/store/09d/09d98515-dd90-4fc5-b303-a84ab6dcf315/wv.sql from query ATTACH WINDOW VIEW test_9.wv UUID '0745b061-58f7-49bd-817a-9cb1a1375922' TO test_9.dst (`count` UInt64, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, tumbleEnd(wid) AS w_end FROM test_9.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 22:59:58.351689 [ 14955 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 23:00:10.352736 [ 14134 ] {} <Error> Application: Code: 696. DB::Exception: Load job 'startup table 01056_window_view_proc_hop_watch.wv' -> Code: 695. DB::Exception: Load job 'load table 01056_window_view_proc_hop_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED) (version 24.3.12.76.altinitystable). (ASYNC_LOAD_CANCELED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Common/AsyncLoader.cpp:73: DB::cancelOnDependencyFailure(std::shared_ptr<DB::LoadJob> const&, std::shared_ptr<DB::LoadJob> const&, std::exception_ptr&) @ 0x00000000135e6076
7. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0d21ed
8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0d21ad
9. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0d216d
10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0d2115
11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001360214e
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f568d
13. /build/src/Common/AsyncLoader.cpp:627: DB::AsyncLoader::finish(std::shared_ptr<DB::LoadJob> const&, DB::LoadStatus, std::exception_ptr, std::unique_lock<std::mutex>&) @ 0x00000000135ed01f
14. /build/src/Common/AsyncLoader.cpp:898: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f181e
15. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f40b5
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f4095
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f4075
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f403d
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
22. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
23. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
25. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
26. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
27. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
 (version 24.3.12.76.altinitystable)
2025.03.05 23:00:11.639041 [ 14981 ] {} <Warning> Context: Server was built in debug mode. It will work slowly.
2025.03.05 23:00:11.668999 [ 14981 ] {} <Warning> Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production.
2025.03.05 23:00:11.670242 [ 14981 ] {} <Warning> Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl.
2025.03.05 23:00:11.672855 [ 14981 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2025.03.05 23:00:11.673000 [ 14981 ] {} <Warning> Application: Integrity check of the executable skipped because the reference checksum could not be read.
2025.03.05 23:00:16.868388 [ 14981 ] {} <Warning> CloudPlacementInfo: Placement info has not been loaded
2025.03.05 23:00:17.279909 [ 14981 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2025.03.05 23:00:17.285841 [ 14981 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2025.03.05 23:00:17.285938 [ 14981 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2025.03.05 23:00:17.337525 [ 15634 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2025.03.05 23:00:21.171391 [ 14981 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2025.03.05 23:00:23.115646 [ 14981 ] {} <Warning> TablesLoader: Tables test_9.dist_01213 depend on default.id, but seems like that does not exist. Will ignore it and try to load existing tables
2025.03.05 23:00:23.354758 [ 15822 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 23:00:23.354996 [ 15804 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_9`.`wv` from metadata file /var/lib/clickhouse/store/09d/09d98515-dd90-4fc5-b303-a84ab6dcf315/wv.sql from query ATTACH WINDOW VIEW test_9.wv UUID '0745b061-58f7-49bd-817a-9cb1a1375922' TO test_9.dst (`count` UInt64, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, tumbleEnd(wid) AS w_end FROM test_9.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 23:00:31.800171 [ 15637 ] {} <Error> RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled
2025.03.05 23:00:33.385833 [ 14981 ] {} <Error> Application: Code: 696. DB::Exception: Load job 'startup table 01056_window_view_proc_hop_watch.wv' -> Code: 695. DB::Exception: Load job 'load table 01056_window_view_proc_hop_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED) (version 24.3.12.76.altinitystable). (ASYNC_LOAD_CANCELED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Common/AsyncLoader.cpp:73: DB::cancelOnDependencyFailure(std::shared_ptr<DB::LoadJob> const&, std::shared_ptr<DB::LoadJob> const&, std::exception_ptr&) @ 0x00000000135e6076
7. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0d21ed
8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0d21ad
9. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0d216d
10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0d2115
11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001360214e
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f568d
13. /build/src/Common/AsyncLoader.cpp:627: DB::AsyncLoader::finish(std::shared_ptr<DB::LoadJob> const&, DB::LoadStatus, std::exception_ptr, std::unique_lock<std::mutex>&) @ 0x00000000135ed01f
14. /build/src/Common/AsyncLoader.cpp:898: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f181e
15. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f40b5
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f4095
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f4075
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f403d
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
22. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
23. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
25. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
26. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
27. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
 (version 24.3.12.76.altinitystable)
2025.03.05 23:00:34.675340 [ 15842 ] {} <Warning> Context: Server was built in debug mode. It will work slowly.
2025.03.05 23:00:34.705438 [ 15842 ] {} <Warning> Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production.
2025.03.05 23:00:34.706756 [ 15842 ] {} <Warning> Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl.
2025.03.05 23:00:34.709400 [ 15842 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2025.03.05 23:00:34.709556 [ 15842 ] {} <Warning> Application: Integrity check of the executable skipped because the reference checksum could not be read.
2025.03.05 23:00:39.754593 [ 15842 ] {} <Warning> CloudPlacementInfo: Placement info has not been loaded
2025.03.05 23:00:40.155092 [ 15842 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2025.03.05 23:00:40.161038 [ 15842 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2025.03.05 23:00:40.161134 [ 15842 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2025.03.05 23:00:40.212822 [ 16494 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2025.03.05 23:00:44.299879 [ 15842 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2025.03.05 23:00:45.428881 [ 15842 ] {} <Warning> TablesLoader: Tables test_9.dist_01213 depend on default.id, but seems like that does not exist. Will ignore it and try to load existing tables
2025.03.05 23:00:45.763021 [ 16624 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 23:00:45.763127 [ 16642 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_9`.`wv` from metadata file /var/lib/clickhouse/store/09d/09d98515-dd90-4fc5-b303-a84ab6dcf315/wv.sql from query ATTACH WINDOW VIEW test_9.wv UUID '0745b061-58f7-49bd-817a-9cb1a1375922' TO test_9.dst (`count` UInt64, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, tumbleEnd(wid) AS w_end FROM test_9.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 23:00:55.688429 [ 15842 ] {} <Error> Application: Code: 696. DB::Exception: Load job 'startup table 01056_window_view_proc_hop_watch.wv' -> Code: 695. DB::Exception: Load job 'load table 01056_window_view_proc_hop_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED) (version 24.3.12.76.altinitystable). (ASYNC_LOAD_CANCELED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Common/AsyncLoader.cpp:73: DB::cancelOnDependencyFailure(std::shared_ptr<DB::LoadJob> const&, std::shared_ptr<DB::LoadJob> const&, std::exception_ptr&) @ 0x00000000135e6076
7. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0d21ed
8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0d21ad
9. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0d216d
10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0d2115
11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001360214e
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f568d
13. /build/src/Common/AsyncLoader.cpp:627: DB::AsyncLoader::finish(std::shared_ptr<DB::LoadJob> const&, DB::LoadStatus, std::exception_ptr, std::unique_lock<std::mutex>&) @ 0x00000000135ed01f
14. /build/src/Common/AsyncLoader.cpp:898: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f181e
15. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f40b5
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f4095
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f4075
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f403d
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
22. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
23. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
25. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
26. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
27. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
 (version 24.3.12.76.altinitystable)
2025.03.05 23:00:56.994294 [ 16727 ] {} <Warning> Context: Server was built in debug mode. It will work slowly.
2025.03.05 23:00:57.024410 [ 16727 ] {} <Warning> Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production.
2025.03.05 23:00:57.025667 [ 16727 ] {} <Warning> Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl.
2025.03.05 23:00:57.028272 [ 16727 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2025.03.05 23:00:57.028423 [ 16727 ] {} <Warning> Application: Integrity check of the executable skipped because the reference checksum could not be read.
2025.03.05 23:01:01.975132 [ 16727 ] {} <Warning> CloudPlacementInfo: Placement info has not been loaded
2025.03.05 23:01:02.385018 [ 16727 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2025.03.05 23:01:02.390889 [ 16727 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2025.03.05 23:01:02.390994 [ 16727 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2025.03.05 23:01:02.442486 [ 17379 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2025.03.05 23:01:06.280947 [ 16727 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2025.03.05 23:01:07.596963 [ 16727 ] {} <Warning> TablesLoader: Tables test_9.dist_01213 depend on default.id, but seems like that does not exist. Will ignore it and try to load existing tables
2025.03.05 23:01:07.875156 [ 17513 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 23:01:17.891769 [ 16727 ] {} <Error> Application: Code: 696. DB::Exception: Load job 'startup table 01056_window_view_proc_hop_watch.wv' -> Code: 695. DB::Exception: Load job 'load table 01056_window_view_proc_hop_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED) (version 24.3.12.76.altinitystable). (ASYNC_LOAD_CANCELED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Common/AsyncLoader.cpp:73: DB::cancelOnDependencyFailure(std::shared_ptr<DB::LoadJob> const&, std::shared_ptr<DB::LoadJob> const&, std::exception_ptr&) @ 0x00000000135e6076
7. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0d21ed
8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0d21ad
9. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0d216d
10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0d2115
11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001360214e
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f568d
13. /build/src/Common/AsyncLoader.cpp:627: DB::AsyncLoader::finish(std::shared_ptr<DB::LoadJob> const&, DB::LoadStatus, std::exception_ptr, std::unique_lock<std::mutex>&) @ 0x00000000135ed01f
14. /build/src/Common/AsyncLoader.cpp:898: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f181e
15. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f40b5
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f4095
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f4075
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f403d
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
22. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
23. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
25. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
26. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
27. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
 (version 24.3.12.76.altinitystable)
2025.03.05 23:01:19.189214 [ 17581 ] {} <Warning> Context: Server was built in debug mode. It will work slowly.
2025.03.05 23:01:19.221013 [ 17581 ] {} <Warning> Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production.
2025.03.05 23:01:19.222364 [ 17581 ] {} <Warning> Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl.
2025.03.05 23:01:19.225144 [ 17581 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2025.03.05 23:01:19.225293 [ 17581 ] {} <Warning> Application: Integrity check of the executable skipped because the reference checksum could not be read.
2025.03.05 23:01:24.094274 [ 17581 ] {} <Warning> CloudPlacementInfo: Placement info has not been loaded
2025.03.05 23:01:24.502465 [ 17581 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2025.03.05 23:01:24.508234 [ 17581 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2025.03.05 23:01:24.508328 [ 17581 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2025.03.05 23:01:24.560003 [ 18233 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2025.03.05 23:01:27.965344 [ 17581 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2025.03.05 23:01:29.703169 [ 17581 ] {} <Warning> TablesLoader: Tables test_9.dist_01213 depend on default.id, but seems like that does not exist. Will ignore it and try to load existing tables
2025.03.05 23:01:29.950732 [ 18384 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 23:01:39.455079 [ 17581 ] {} <Error> Application: Code: 696. DB::Exception: Load job 'startup table 01056_window_view_proc_hop_watch.wv' -> Code: 695. DB::Exception: Load job 'load table 01056_window_view_proc_hop_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED) (version 24.3.12.76.altinitystable). (ASYNC_LOAD_CANCELED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Common/AsyncLoader.cpp:73: DB::cancelOnDependencyFailure(std::shared_ptr<DB::LoadJob> const&, std::shared_ptr<DB::LoadJob> const&, std::exception_ptr&) @ 0x00000000135e6076
7. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0d21ed
8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0d21ad
9. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0d216d
10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0d2115
11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001360214e
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f568d
13. /build/src/Common/AsyncLoader.cpp:627: DB::AsyncLoader::finish(std::shared_ptr<DB::LoadJob> const&, DB::LoadStatus, std::exception_ptr, std::unique_lock<std::mutex>&) @ 0x00000000135ed01f
14. /build/src/Common/AsyncLoader.cpp:898: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f181e
15. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f40b5
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f4095
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f4075
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f403d
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
22. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
23. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
25. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
26. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
27. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
 (version 24.3.12.76.altinitystable)
2025.03.05 23:01:40.739517 [ 18413 ] {} <Warning> Context: Server was built in debug mode. It will work slowly.
2025.03.05 23:01:40.770104 [ 18413 ] {} <Warning> Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production.
2025.03.05 23:01:40.771404 [ 18413 ] {} <Warning> Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl.
2025.03.05 23:01:40.774045 [ 18413 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2025.03.05 23:01:40.774196 [ 18413 ] {} <Warning> Application: Integrity check of the executable skipped because the reference checksum could not be read.
2025.03.05 23:01:45.355130 [ 18413 ] {} <Warning> CloudPlacementInfo: Placement info has not been loaded
2025.03.05 23:01:45.766137 [ 18413 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2025.03.05 23:01:45.772058 [ 18413 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2025.03.05 23:01:45.772156 [ 18413 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2025.03.05 23:01:45.823564 [ 19064 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2025.03.05 23:01:49.742739 [ 18413 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2025.03.05 23:01:50.994289 [ 18413 ] {} <Warning> TablesLoader: Tables test_9.dist_01213 depend on default.id, but seems like that does not exist. Will ignore it and try to load existing tables
2025.03.05 23:01:51.216134 [ 19165 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 23:02:01.185263 [ 18413 ] {} <Error> Application: Code: 696. DB::Exception: Load job 'startup table 01056_window_view_proc_hop_watch.wv' -> Code: 695. DB::Exception: Load job 'load table 01056_window_view_proc_hop_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED) (version 24.3.12.76.altinitystable). (ASYNC_LOAD_CANCELED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Common/AsyncLoader.cpp:73: DB::cancelOnDependencyFailure(std::shared_ptr<DB::LoadJob> const&, std::shared_ptr<DB::LoadJob> const&, std::exception_ptr&) @ 0x00000000135e6076
7. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0d21ed
8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0d21ad
9. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0d216d
10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0d2115
11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001360214e
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f568d
13. /build/src/Common/AsyncLoader.cpp:627: DB::AsyncLoader::finish(std::shared_ptr<DB::LoadJob> const&, DB::LoadStatus, std::exception_ptr, std::unique_lock<std::mutex>&) @ 0x00000000135ed01f
14. /build/src/Common/AsyncLoader.cpp:898: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f181e
15. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f40b5
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f4095
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f4075
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f403d
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
22. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
23. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
25. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
26. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
27. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
 (version 24.3.12.76.altinitystable)
2025.03.05 23:02:02.483962 [ 19247 ] {} <Warning> Context: Server was built in debug mode. It will work slowly.
2025.03.05 23:02:02.514330 [ 19247 ] {} <Warning> Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production.
2025.03.05 23:02:02.515717 [ 19247 ] {} <Warning> Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl.
2025.03.05 23:02:02.518411 [ 19247 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2025.03.05 23:02:02.518590 [ 19247 ] {} <Warning> Application: Integrity check of the executable skipped because the reference checksum could not be read.
2025.03.05 23:02:07.059819 [ 19247 ] {} <Warning> CloudPlacementInfo: Placement info has not been loaded
2025.03.05 23:02:07.451768 [ 19247 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2025.03.05 23:02:07.457638 [ 19247 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2025.03.05 23:02:07.457733 [ 19247 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2025.03.05 23:02:07.509257 [ 19898 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2025.03.05 23:02:11.233850 [ 19247 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2025.03.05 23:02:12.715451 [ 19247 ] {} <Warning> TablesLoader: Tables test_9.dist_01213 depend on default.id, but seems like that does not exist. Will ignore it and try to load existing tables
2025.03.05 23:02:12.940284 [ 20076 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 23:02:21.957687 [ 19901 ] {} <Error> RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled
2025.03.05 23:02:23.294959 [ 19247 ] {} <Error> Application: Code: 696. DB::Exception: Load job 'startup table 01056_window_view_proc_hop_watch.wv' -> Code: 695. DB::Exception: Load job 'load table 01056_window_view_proc_hop_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED) (version 24.3.12.76.altinitystable). (ASYNC_LOAD_CANCELED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Common/AsyncLoader.cpp:73: DB::cancelOnDependencyFailure(std::shared_ptr<DB::LoadJob> const&, std::shared_ptr<DB::LoadJob> const&, std::exception_ptr&) @ 0x00000000135e6076
7. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0d21ed
8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0d21ad
9. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0d216d
10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0d2115
11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001360214e
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f568d
13. /build/src/Common/AsyncLoader.cpp:627: DB::AsyncLoader::finish(std::shared_ptr<DB::LoadJob> const&, DB::LoadStatus, std::exception_ptr, std::unique_lock<std::mutex>&) @ 0x00000000135ed01f
14. /build/src/Common/AsyncLoader.cpp:898: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f181e
15. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f40b5
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f4095
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f4075
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f403d
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
22. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
23. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
25. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
26. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
27. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
 (version 24.3.12.76.altinitystable)
2025.03.05 23:02:25.543290 [ 20096 ] {} <Warning> Context: Server was built in debug mode. It will work slowly.
2025.03.05 23:02:25.574384 [ 20096 ] {} <Warning> Context: Server logging level is set to 'test' and performance is degraded. This cannot be used in production.
2025.03.05 23:02:25.575731 [ 20096 ] {} <Warning> Context: Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. You can enable it using `echo 1 > /proc/sys/kernel/task_delayacct` or by using sysctl.
2025.03.05 23:02:25.578434 [ 20096 ] {} <Warning> Context: The setting 'allow_remote_fs_zero_copy_replication' is enabled for MergeTree tables. But the feature of 'zero-copy replication' is under development and is not ready for production. The usage of this feature can lead to data corruption and loss. The setting should be disabled in production.
2025.03.05 23:02:25.578584 [ 20096 ] {} <Warning> Application: Integrity check of the executable skipped because the reference checksum could not be read.
2025.03.05 23:02:29.897688 [ 20096 ] {} <Warning> CloudPlacementInfo: Placement info has not been loaded
2025.03.05 23:02:30.316853 [ 20096 ] {} <Warning> KeeperServer: Got 1000000000000000 value for setting 'reserved_log_items' which is bigger than int32_t max value, lowering value to 2147483647.
2025.03.05 23:02:30.322896 [ 20096 ] {} <Warning> RaftInstance: invalid election timeout lower bound detected, adjusted to 0
2025.03.05 23:02:30.322992 [ 20096 ] {} <Warning> RaftInstance: invalid election timeout upper bound detected, adjusted to 0
2025.03.05 23:02:30.374583 [ 20747 ] {} <Warning> RaftInstance: Election timeout, initiate leader election
2025.03.05 23:02:34.259619 [ 20096 ] {} <Warning> Context: Table system.session_log is enabled. It's unreliable and may contain garbage. Do not use it for any kind of security monitoring.
2025.03.05 23:04:13.965858 [ 20096 ] {} <Warning> TablesLoader: Tables test_9.dist_01213 depend on default.id, but seems like that does not exist. Will ignore it and try to load existing tables
2025.03.05 23:04:14.189357 [ 20923 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 23:04:14.189432 [ 20893 ] {} <Error> void DB::AsyncLoader::worker(Pool &): Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `test_9`.`wv` from metadata file /var/lib/clickhouse/store/09d/09d98515-dd90-4fc5-b303-a84ab6dcf315/wv.sql from query ATTACH WINDOW VIEW test_9.wv UUID '0745b061-58f7-49bd-817a-9cb1a1375922' TO test_9.dst (`count` UInt64, `w_end` DateTime('US/Samoa')) WATERMARK ASCENDING AS SELECT count(a) AS count, tumbleEnd(wid) AS w_end FROM test_9.mt GROUP BY tumble(timestamp, toIntervalSecond('5'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable)
2025.03.05 23:04:23.699008 [ 20755 ] {} <Error> RaftInstance: failed to accept a rpc connection due to error 125, Operation canceled
2025.03.05 23:04:24.733011 [ 20096 ] {} <Error> Application: Code: 696. DB::Exception: Load job 'startup table 01056_window_view_proc_hop_watch.wv' -> Code: 695. DB::Exception: Load job 'load table 01056_window_view_proc_hop_watch.wv' failed: Code: 1. DB::Exception: Experimental WINDOW VIEW feature is not supported with new infrastructure for query analysis (the setting 'allow_experimental_analyzer'): Cannot attach table `01056_window_view_proc_hop_watch`.`wv` from metadata file /var/lib/clickhouse/store/262/262e7e1e-7d59-40ac-bad0-55a22f9f5e76/wv.sql from query ATTACH WINDOW VIEW `01056_window_view_proc_hop_watch`.wv UUID '316bf155-e5bc-423a-adad-160db5599cda' (`count` UInt64) ENGINE = Memory AS SELECT count(a) AS count FROM `01056_window_view_proc_hop_watch`.mt GROUP BY hop(timestamp, toIntervalSecond('1'), toIntervalSecond('1'), 'US/Samoa') AS wid. (UNSUPPORTED_METHOD), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<>(int, FormatStringHelperImpl<>) @ 0x000000000a8f3cb7
6. /build/src/Storages/WindowView/StorageWindowView.cpp:1181: DB::StorageWindowView::StorageWindowView(DB::StorageID const&, std::shared_ptr<DB::Context const>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel) @ 0x000000001d16fa0d
7. /build/contrib/llvm-project/libcxx/include/__memory/construct_at.h:35: DB::StorageWindowView* std::construct_at[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, DB::StorageWindowView*>(DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d1893e3
8. /build/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:302: void std::allocator_traits<std::allocator<DB::StorageWindowView>>::construct[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void, void>(std::allocator<DB::StorageWindowView>&, DB::StorageWindowView*, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d189161
9. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292: std::__shared_ptr_emplace<DB::StorageWindowView, std::allocator<DB::StorageWindowView>>::__shared_ptr_emplace[abi:v15000]<DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&>(std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188e2d
10. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953: std::shared_ptr<DB::StorageWindowView> std::allocate_shared[abi:v15000]<DB::StorageWindowView, std::allocator<DB::StorageWindowView>, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(std::allocator<DB::StorageWindowView> const&, DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c7a
11. /build/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962: std::shared_ptr<DB::StorageWindowView> std::make_shared[abi:v15000]<DB::StorageWindowView, DB::StorageID const&, std::shared_ptr<DB::Context>, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&, void>(DB::StorageID const&, std::shared_ptr<DB::Context>&&, DB::ASTCreateQuery const&, DB::ColumnsDescription const&, DB::LoadingStrictnessLevel const&) @ 0x000000001d188c06
12. /build/src/Storages/WindowView/StorageWindowView.cpp:1693: DB::registerStorageWindowView(DB::StorageFactory&)::$_0::operator()(DB::StorageFactory::Arguments const&) const @ 0x000000001d17c5a6
13. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001d17c41d
14. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:470: ? @ 0x000000001d17c3bd
15. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001d17c37d
16. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001d17c345
17. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001c36f7de
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x000000001c36e0fd
19. /build/src/Storages/StorageFactory.cpp:224: DB::StorageFactory::get(DB::ASTCreateQuery const&, String const&, std::shared_ptr<DB::Context>, std::shared_ptr<DB::Context>, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, DB::LoadingStrictnessLevel) const @ 0x000000001c36ca1d
20. /build/src/Databases/DatabaseOnDisk.cpp:120: DB::createTableFromAST(DB::ASTCreateQuery, String const&, String const&, std::shared_ptr<DB::Context>, DB::LoadingStrictnessLevel) @ 0x000000001a0af552
21. /build/src/Databases/DatabaseOrdinary.cpp:248: DB::DatabaseOrdinary::loadTableFromMetadata(std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel) @ 0x000000001a0d827b
22. /build/src/Databases/DatabaseOrdinary.cpp:283: DB::DatabaseOrdinary::loadTableFromMetadataAsync(DB::AsyncLoader&, std::unordered_set<std::shared_ptr<DB::LoadJob>, std::hash<std::shared_ptr<DB::LoadJob>>, std::equal_to<std::shared_ptr<DB::LoadJob>>, std::allocator<std::shared_ptr<DB::LoadJob>>>, std::shared_ptr<DB::Context>, String const&, DB::QualifiedTableName const&, std::shared_ptr<DB::IAST> const&, DB::LoadingStrictnessLevel)::$_0::operator()(DB::AsyncLoader&, std::shared_ptr<DB::LoadJob> const&) const @ 0x000000001a0dfa63
23. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0df9e5
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0df9a5
25. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0df965
26. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0df930
27. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x00000000135fe246
28. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f48c5
29. /build/src/Common/AsyncLoader.cpp:169: DB::LoadJob::execute(DB::AsyncLoader&, unsigned long, std::shared_ptr<DB::LoadJob> const&) @ 0x00000000135e670b
30. /build/src/Common/AsyncLoader.cpp:937: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f2d67
31. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
 (version 24.3.12.76.altinitystable). (ASYNC_LOAD_FAILED) (version 24.3.12.76.altinitystable). (ASYNC_LOAD_CANCELED), Stack trace (when copying this message, always include the lines below):

0. /build/contrib/llvm-project/libcxx/include/exception:141: std::exception::capture() @ 0x000000000a8f8182
1. /build/contrib/llvm-project/libcxx/include/exception:116: std::exception::exception[abi:v15000]() @ 0x000000000a8f814d
2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x0000000022a03aa0
3. /build/src/Common/Exception.cpp:94: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000132ba32e
4. /build/src/Common/Exception.h:90: DB::Exception::Exception(String&&, int, bool) @ 0x000000000a8eed2a
5. /build/src/Common/Exception.h:109: DB::Exception::Exception<String const&, String>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<String>::type>, String const&, String&&) @ 0x000000000b4fd2cc
6. /build/src/Common/AsyncLoader.cpp:73: DB::cancelOnDependencyFailure(std::shared_ptr<DB::LoadJob> const&, std::shared_ptr<DB::LoadJob> const&, std::exception_ptr&) @ 0x00000000135e6076
7. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x000000001a0d21ed
8. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x000000001a0d21ad
9. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x000000001a0d216d
10. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001a0d2115
11. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x000000001360214e
12. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x00000000135f568d
13. /build/src/Common/AsyncLoader.cpp:627: DB::AsyncLoader::finish(std::shared_ptr<DB::LoadJob> const&, DB::LoadStatus, std::exception_ptr, std::unique_lock<std::mutex>&) @ 0x00000000135ed01f
14. /build/src/Common/AsyncLoader.cpp:898: DB::AsyncLoader::worker(DB::AsyncLoader::Pool&) @ 0x00000000135f181e
15. /build/src/Common/AsyncLoader.cpp:872: DB::AsyncLoader::spawn(DB::AsyncLoader::Pool&, std::unique_lock<std::mutex>&)::$_1::operator()() const @ 0x00000000135f40dc
16. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000135f40b5
17. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000135f4095
18. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000135f4075
19. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000135f403d
20. /build/contrib/llvm-project/libcxx/include/__functional/function.h:848: ? @ 0x0000000011b42fb6
21. /build/contrib/llvm-project/libcxx/include/__functional/function.h:1187: ? @ 0x0000000011b42bf5
22. /build/src/Common/ThreadPool.cpp:526: ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::worker(std::__list_iterator<ThreadFromGlobalPoolImpl<false>, void*>) @ 0x00000000133d7e82
23. /build/src/Common/ThreadPool.cpp:253: void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()::operator()() const @ 0x00000000133e1cc4
24. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1c95
25. /build/contrib/llvm-project/libcxx/include/tuple:1789: decltype(auto) std::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&, std::__tuple_indices<>) @ 0x00000000133e1c79
26. /build/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()&, std::tuple<>&>(void&&, std::tuple<>&) @ 0x00000000133e1b1d
27. /build/src/Common/ThreadPool.h:225: ThreadFromGlobalPoolImpl<false>::ThreadFromGlobalPoolImpl<void ThreadPoolImpl<ThreadFromGlobalPoolImpl<false>>::scheduleImpl<void>(std::function<void ()>, Priority, std::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() @ 0x00000000133e19e5
28. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ? @ 0x00000000133e1955
29. /build/contrib/llvm-project/libcxx/include/__functional/invoke.h:480: ? @ 0x00000000133e1935
30. /build/contrib/llvm-project/libcxx/include/__functional/function.h:235: ? @ 0x00000000133e1915
31. /build/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000133e18e0
 (version 24.3.12.76.altinitystable)